Program, method, and terminal device

ABSTRACT

First display data is received to enable display of a video of a virtual space including a first character, which moves in cooperation with a behavior of a performer. A video is displayed in which the first character behaves in the virtual space on the basis of the first display data. The first character is associated with a prescribed first object, and a display mode of the first object is changed in accordance with a predetermined rule.

TECHNICAL FIELD

The present invention relates to a program, a method, and a terminaldevice.

BACKGROUND ART

Conventionally, there is a system for displaying a virtual charactercontrolled by a performer. In such a system, the virtual character isattached with a decoration object for which a display request is made bya user.

CITATION LIST Patent Literature

-   PTL 1: Japanese Patent No. 6420930

SUMMARY OF INVENTION Technical Problem

However, in the conventional system, a part corresponding to the requestfrom the user is decorated in accordance with the request. For thisreason, for example, the user does not feel a sense of reality that thedisplay mode of a specific part of the virtual character changesspontaneously, and there is room for improvement.

The present invention has been conceived in view of such circumstances,and an object thereof is to provide a program, a method, and a terminaldevice which are capable of giving a user a sense of reality of avirtual character.

Solution to Problem

According to an aspect of an embodiment shown in the present disclosure,there is provided a program to be executed in a terminal device whichcomprises a processor, the program causing the processor to executesteps of: receiving first display data for enabling display of a videoof a virtual space including a first character, which moves incooperation with a behavior of a performer; and displaying a video inwhich the first character behaves in the virtual space, on the basis ofthe first display data, wherein: the first character is associated witha prescribed first object; and a display mode of the first object ischanged in accordance with a predetermined rule.

Advantageous Effects of Invention

According to the present invention, it is possible to give a user asense of reality of a virtual character.

BRIEF DESCRIPTION OF DRAWINGS

FIG. 1 is a diagram showing an overview of a system according to anembodiment.

FIG. 2 is a diagram showing a hardware configuration of a user terminalaccording to an embodiment.

FIG. 3 is a diagram showing a hardware configuration of a serveraccording to an embodiment.

FIG. 4 is a diagram showing a hardware configuration of a game playterminal according to an embodiment.

FIG. 5 is a diagram showing a hardware configuration of a transmissionterminal according to an embodiment.

FIG. 6 is a block diagram showing functional configurations of a userterminal, a server, and an HMD set according to an embodiment.

FIG. 7 is a block diagram showing an example of a functionalconfiguration of a transmission terminal according to an embodiment.

FIG. 8 is a flowchart showing a part of processing executed by the userterminal and the game play terminal according to an embodiment.

FIGS. 9A and 9B are diagrams showing a virtual space provided to aplayer and a field-of-view image visually recognized by the playeraccording to an embodiment.

FIGS. 10A and 10B are diagrams showing a virtual space provided to auser of the user terminal and a field-of-view image visually recognizedby the user according to an embodiment.

FIGS. 11A to 11D are diagrams showing another example of a field-of-viewimage visually recognized by the user of the user terminal.

FIGS. 12A to 12D are diagrams showing further another example of afield-of-view image visually recognized by the user of the userterminal.

FIG. 13 is a flowchart showing a part of processing to be executed inthe game play terminal according to an embodiment.

FIG. 14 is a flowchart showing a part of processing to be executed inthe user terminal according to an embodiment.

FIG. 15 is a flowchart showing a part of processing to be executed inthe server according to an embodiment.

FIG. 16 is a diagram showing a specific example of a list of users whoparticipate in a game according to an embodiment.

FIG. 17 is a flowchart showing a part of processing to be executed inthe transmission terminal according to an embodiment.

FIGS. 18A and 18B are diagrams showing a specific example of a screendisplayed on the transmission terminal according to an embodiment.

FIG. 19 is a diagram showing another specific example of a screendisplayed on the transmission terminal according to an embodiment.

FIG. 20 is a diagram showing a specific example of a sound input by aplayer according to an embodiment.

FIGS. 21A to 21C are diagrams showing further another specific exampleof a screen displayed on the transmission terminal according to anembodiment and an overview of transmission of behavior instruction data.

FIG. 22 is a diagram showing another specific example of a sound inputby a player according to an embodiment.

FIGS. 23A to 23C are diagrams showing further another specific exampleof a screen displayed on the transmission terminal according to anembodiment and an overview of transmission of behavior instruction data.

FIG. 24 is a diagram showing an overview of sending of game progressinformation from the game play terminal to the user terminal accordingto an embodiment.

FIG. 25 is a flowchart showing a part of processing to be executed inthe user terminal according to an embodiment.

FIG. 26 is a diagram showing a specific example of moving imagereproduction.

FIG. 27 is a diagram showing another specific example of moving imagereproduction.

FIG. 28A is a flowchart showing an example of a display mode controlprocess on a game play terminal side, and FIG. 28B is a flowchartshowing an example of a display mode setting process on a user terminalside.

FIG. 29A is a diagram showing an example of an Nth live transmissionvideo, FIG. 28B is a diagram showing an example of an (N+1)th livetransmission video, and FIG. 28C is a diagram showing an example of an(N+2)th live transmission video.

FIG. 30A is a diagram showing an example of a live transmission video ina normal viewing mode, and FIG. 30B is a diagram showing an example of alive transmission video in an AR viewing mode.

DESCRIPTION OF EMBODIMENTS

A system according to the present disclosure is a system for providing agame to a plurality of users. The system will be described below withreference to the drawings. The present invention is not limited to theseillustrations but is indicated by the scope of the claims, and it isintended that the present invention includes all modifications withinthe meaning and scope equivalent to the scope of the claims. In thefollowing description, the same components are denoted by the samereference numerals in the description of the drawings, and will not berepeatedly described.

<Overview of Operations of System 1>

FIG. 1 is a diagram showing an overview of a system 1 according to thepresent embodiment. The system 1 includes a plurality of user terminals100 (computers), a server 200, a game play terminal 300 (an externaldevice, a second external device), and a transmission terminal 400 (anexternal device, a first external device). In FIG. 1, user terminals100A to 100C, that is, three user terminals 100 are shown as an exampleof the plurality of user terminals 100, but the number of user terminals100 is not limited to the shown example. In the present embodiment, theuser terminals 100A to 100C are described as “user terminals 100” whenbeing not necessary to be distinguished from each other. The userterminal 100, the game play terminal 300, and the transmission terminal400 are connected to the server 200 via a network 2. The network 2 isconfigured by various mobile communication systems constructed by theInternet and a wireless base station. Examples of the mobilecommunication system include so-called 3G and 4G mobile communicationsystems, LTE (Long Term Evolution), and a wireless network (for example,Wi-Fi (registered trademark)) that can be connected to the Internetthrough a predetermined access point.

(Overview of Game)

In the present embodiment, as an example of a game provided by thesystem 1 (hereinafter, referred to as “main game”), a game mainly playedby the user of the game play terminal 300 will be described.Hereinafter, the user of the game play terminal 300 called a “player”.As an example, the player (performer) operates one or more charactersappearing in the main game to carry on the game. In the main game, theuser of the user terminal 100 plays a role of supporting the progress ofthe game by the player. Details of the main game will be describedbelow. The game provided by the system 1 may be a game in which aplurality of users participate, and no limitation to this example isintended.

(Game Play Terminal 300)

The game play terminal 300 controls the progress of the game in responseto operations input by the player. Further, the game play terminal 300sequentially transmits information (hereinafter, game progressinformation) generated by a player's game play to the server 200 in realtime.

(Server 200)

The server 200 sends the game progress information (second data)received in real time from the game play terminal 300, to the userterminal 100. In addition, the server 200 mediates the sending andreception of various types of information between the user terminal 100,the game play terminal 300, and the transmission terminal 400.

(Transmission Terminal 400)

The transmission terminal 400 generates behavior instruction data (firstdata) in response to operations input by the user of the transmissionterminal 400, and transmits the behavior instruction data to the userterminal 100 via the server 200. The behavior instruction data is datafor reproducing a moving image on the user terminal 100, andspecifically, is data for producing behaviors of characters appearing inthe moving image.

In the present embodiment, as an example, the user of the transmissionterminal 400 is a player of the main game. Further, as an example, themoving image reproduced on the user terminal 100 based on the behaviorinstruction data is a moving image in which the characters operated bythe player in the game behave. The “behavior” is to move at least a partof a character's body, and also includes a speech. Therefore, thebehavior instruction data according to the present embodiment includes,for example, sound data for controlling the character to speak andmotion data for moving the character's body.

As an example, the behavior instruction data is sent to the userterminal 100 after the main game is over. Details of the behaviorinstruction data and the moving image reproduced based on the behaviorinstruction data will be described below.

(User Terminal 100)

The user terminal 100 receives game progress information in real time,and generate a game screen to display using the information. In otherwords, the user terminal 100 reproduces the game screen of the gamebeing played by the player in real-time rendering. Thereby, the user ofthe user terminal 100 can visually recognize the same game screen as thegame screen that the player visually recognize while playing the game atsubstantially the same timing as the player.

In addition, the user terminal 100 generates information for supportingthe progress of the game by the player in response to the operationinput by the user, and sends the information to the game play terminal300 via the server 200. Details of the information will be describedbelow.

Further, the user terminal 100 receives the behavior instruction datafrom the transmission terminal 400, and generates and reproduces amoving image (video) using the behavior instruction data. In otherwords, the user terminal 100 reproduces the behavior instruction data byrendering.

<Hardware Configuration of System 1>

FIG. 2 is a diagram showing a hardware configuration of the userterminal 100. FIG. 3 is a view showing a hardware configuration of theserver 200. FIG. 4 is a diagram showing a hardware configuration of thegame play terminal 300. FIG. 5 is a diagram showing a hardwareconfiguration of the transmission terminal 400.

(User Terminal 100)

In the present embodiment, as an example, an example is described inwhich the user terminal 100 is implemented as a smartphone, but the userterminal 100 is not limited to the smartphone. For example, the userterminal 100 may be implemented as a feature phone, a tablet computer, alaptop computer (a so-called notebook computer), or a desktop computer.Further, the user terminal 100 may be a game device suitable for a gameplay.

As shown in FIG. 2, the user terminal 100 includes a processor 10, amemory 11 a, a storage 12, a communication interface (IF) 13, aninput/output IF 14, a touch screen 15 (display unit), a camera 17, and aranging sensor 18. These components of the user terminal 100 areelectrically connected to one another via a communication bus. The userterminal 100 may include an input/output IF 14 that can be connected toa display (display unit) configured separately from a main body of theuser terminal 100 instead of or in addition to the touch screen 15.

Further, as shown in FIG. 2, the user terminal 100 may be configured tohave the capability to communicate with one or more controller 1020. Thecontroller 1020 establishes communication with the user terminal 100 inaccordance with a communication standard, for example, Bluetooth(registered trademark). The controller 1020 may include one or morebutton, and sends an output value based on the user's input operation tothe button to the user terminal 100. In addition, the controller 1020may include various sensors such as an acceleration sensor and anangular velocity sensor, and sends the output values of the varioussensors to the user terminal 100.

Instead of or in addition to the user terminal 100 including the camera17 and the ranging sensor 18, the controller 1020 may include the camera17 and the ranging sensor 18.

It is desirable that the user terminal 100 allows a user, who uses thecontroller 1020, to input user identification information such as auser's name or login ID via the controller 1020 at the time of start ofa game, for example. Thereby, the user terminal 100 enables to associatethe controller 1020 with the user, and can specify on the basis of asending source (controller 1020) of the received output value that theoutput value belongs to any user.

When the user terminal 100 communicates with a plurality of controllers1020, each user grasps each of the controllers 1020, so that it ispossible to implement multiplay with one user terminal 100 withoutcommunication with another device such as the server 200 via the network2. In addition, the user terminals 100 communicate with one another inaccordance with a wireless standard such as a wireless LAN (Local AreaNetwork) standard (communicate with one another without using the server200), whereby multiplay can be implemented locally with a plurality ofuser terminals 100. When the above-described multiplay is implementedlocally with one user terminal 100, the user terminal 100 may furtherhave at least a part of various functions (to be described below)provided in the server 200. Further, when the above-described multiplayis implemented locally with the plurality of user terminals 100, theplurality of user terminals 100 may have various functions (to bedescribed below) provided in the server 200 in a distributed manner.

Even when the above-described multiplay is implemented locally, the userterminal 100 may communicate with the server 200. For example, the userterminal may send information indicating a play result such as a recordor win/loss in a certain game and user identification information inassociation with each other to the server 200.

Further, the controller 1020 may be configured to be detachable from theuser terminal 100. In this case, a coupling portion with the controller1020 may be provided on at least any surface of a housing of the userterminal 100, controller 1020. When the user terminal 100 is coupled tothe controller 1020 by a cable via the coupling portion, the userterminal 100 and the controller 1020 sends and receives signals via thecable.

As shown in FIG. 2, the user terminal 100 may be connected to a storagemedium 1030 such as an external memory card via the input/output IF 14.Thereby, the user terminal 100 can read program and data recorded on thestorage medium 1030. The program recorded on the storage medium 1030 isa game program, for example.

The user terminal 100 may store the game program acquired bycommunicating with an external device such as the server 200 in thememory 11 of the user terminal 100, or may store the game programacquired by reading from the storage medium 1030 in the memory 11.

As described above, the user terminal 100 includes the communication IF13, the input/output IF 14, the touch screen 15, the camera 17, and theranging sensor 18 as an example of a mechanism for inputting informationto the user terminal 100. Each of the components described above as aninput mechanism can be regarded as an operation unit configured toreceive a user's input operation.

For example, when the operation unit is configured by at least any oneof the camera 17 and the ranging sensor 18, the operation unit detectsan object 1010 in the vicinity of the user terminal 100, and specifiesan input operation from the detection result of the object. As anexample, a user's hand as the object 1010 or a marker having apredetermined shape is detected, and an input operation is specifiedbased on color, shape, movement, or type of the object 1010 obtained asa detection result. More specifically, when a user's hand is detectedfrom a captured image of the camera 17, the user terminal 100 specifiesa gesture (a series of movements of the user's hand) detected based onthe captured image, as a user's input operation. The captured image maybe a still image or a moving image.

Alternatively, when the operation unit is configured by the touch screen15, the user terminal 100 specifies and receives the user's operationperformed on an input unit 151 of the touch screen 15 as a user's inputoperation. Alternatively, when the operation unit is configured by thecommunication IF 13, the user terminal 100 specifies and receives asignal (for example, an output value) sent from the controller 1020 as auser's input operation. Alternatively, when the operation unit isconfigured by the input/output IF 14, a signal output from an inputdevice (not shown) different from the controller 1020 connected to theinput/output IF 14 is specified and received as a user's inputoperation.

(Server 200)

The server 200 may be a general-purpose computer such as a workstationor a personal computer as an example. The server 200 includes aprocessor 20, a memory 21, a storage 22, a communication IF 23, and aninput/output IF 24. These components in the server 200 are electricallyconnected to one another via a communication bus.

(Game Play Terminal 300)

The game play terminal 300 may be a general-purpose computer such as apersonal computer as an example. The game play terminal 300 includes aprocessor 30, a memory 31, a storage 32, a communication IF 33, and aninput/output IF 34. These components in the game play terminal 300 areelectrically connected to one another via a communication bus.

As shown in FIG. 4, the game play terminal 300 according to the presentembodiment is included in an HMD (Head Mounted Display) set 1000 as anexample. In other words, it can be expressed that the HMD set 1000 isincluded in the system 1, and it can also be expressed that the playerplays a game using the HMD set 1000. A device for the player to play thegame is not limited to the HMD set 1000. As an example, the device maybe any device that allows the player to experience the game virtually.The device may be implemented as a smartphone, a feature phone, a tabletcomputer, a laptop computer (a so-called notebook computer), or adesktop computer. Further, the device may be a game device suitable fora game play.

The HMD set 1000 includes not only the game play terminal 300 but alsoan HMD 500, an HMD sensor 510, a motion sensor 520, a display 530, and acontroller 540. The HMD 500 includes a monitor 51, a gaze sensor 52, afirst camera 53, a second camera 54, a microphone 55, and a speaker 56.The controller 540 may include a motion sensor 520.

The HMD 500 may be mounted on a head of the player to provide a virtualspace to the player during operations. More specifically, the HMD 500displays each of a right-eye image and a left-eye image on the monitor51. When each eye of the player visually recognizes each image, theplayer may recognize the image as a three-dimensional image based on aparallax of both the eyes. The HMD 500 may include either a so-calledhead-mounted display including a monitor or a head-mounted devicecapable of mounting a terminal including a smartphone or anothermonitor.

The monitor 51 is implemented as, for example, a non-transmissivedisplay device. In an aspect, the monitor 51 is arranged on a main bodyof the HMD 500 to be located in front of both eyes of the player.Therefore, when the player visually recognizes the three-dimensionalimage displayed on the monitor 51, the player can be immersed in thevirtual space. In an aspect, the virtual space includes, for example, abackground, player-operatable objects, and player-selectable menuimages. In an aspect, the monitor 51 may be implemented as a liquidcrystal monitor or an organic EL (Electro Luminescence) monitor includedin a so-called smart phone or other information display terminals.

In another aspect, the monitor 51 can be implemented as a transmissivedisplay device. In this case, the HMD 500 may be an open type such as aglasses type, instead of a closed type that covers the player's eyes asshown in FIG. 1. The transmissive monitor 51 may be temporarilyconfigured as a non-transmissive display device by adjustment of itstransmittance. The monitor 51 may include a configuration in which apart of the image constituting the virtual space and a real space aredisplayed at the same time. For example, the monitor 51 may display animage of the real space captured by a camera mounted on the HMD 500, ormay make the real space visually recognizable by setting a part of thetransmittance to be high.

In an aspect, the monitor 51 may include a sub-monitor for displaying aright-eye image and a sub-monitor for displaying a left-eye image. Inanother aspect, the monitor 51 may be configured to integrally displaythe right-eye image and the left-eye image. In this case, the monitor 51includes a high-speed shutter. The high-speed shutter operates to enablealternate display of the right-eye image and the left-eye image so thatonly one of the eyes can recognize the image.

In an aspect, the HMD 500 includes a plurality of light sources (notshown). Each of the light source is implemented by, for example, an LED(Light Emitting Diode) configured to emit infrared rays. The HMD sensor510 has a position tracking function for detecting the movement of theHMD 500. More specifically, the HMD sensor 510 reads a plurality ofinfrared rays emitted by the HMD 500 and detects the position andinclination of the HMD 500 in the real space.

In another aspect, the HMD sensor 510 may be implemented by a camera. Inthis case, the HMD sensor 510 can detect the position and theinclination of the HMD 500 by executing image analysis processing usingimage information of the HMD 500 output from the camera.

In another aspect, the HMD 500 may include a sensor (not shown) as aposition detector instead of the HMD sensor 510 or in addition to theHMD sensor 510. The HMD 500 can use the sensor to detect the positionand the inclination of the HMD 500 itself. For example, when the sensoris an angular velocity sensor, a geomagnetic sensor, or an accelerationsensor, the HMD 500 can use any of those sensors instead of the HMDsensor 510 to detect its position and inclination. As an example, whenthe sensor provided in the HMD 500 is an angular velocity sensor, theangular velocity sensor detects an angular velocity around each of threeaxes of the HMD 500 in the real space over time. The HMD 500 calculatesa temporal change of the angle around each of the three axes of the HMD500 based on each of the angular velocities, and further calculates aninclination of the HMD 500 based on the temporal change of the angles.

The gaze sensor 52 detects a direction in which lines of sight of theright eye and the left eye of the player are directed. The gaze sensor52 detects the lines of sight of the player. The direction of the lineof sight is detected by, for example, a known eye tracking function. Thegaze sensor 52 is implemented by a sensor having the eye trackingfunction. In an aspect, the gaze sensor 52 preferably includes aright-eye sensor and a left-eye sensor. The gaze sensor 52 may be, forexample, a sensor configured to irradiate the right eye and the left eyeof the player with infrared light and to receive reflection light fromthe cornea and the iris with respect to the irradiation light, therebydetecting a rotational angle of each eyeball. The gaze sensor 52 candetect the line of sight of the player based on each of the detectedrotational angles.

The first camera 53 captures a lower part of the player's face. Morespecifically, the first camera 53 captures a nose and a mouse of theplayer. The second camera 54 captures eyes and eyebrows of the player.The housing of the HMD 500 on the player side is defined as an inside ofthe HMD 500, and the housing of the HMD 500 on the side opposite to theplayer. In an aspect, the first camera 53 can be located outside the HMD500, and the second camera 54 can be located inside the HMD 500. Theimaged generated by the first camera 53 and the second camera 54 areinput to the game play terminal 300. In another aspect, the first camera53 and the second camera 54 may be implemented as one camera, and theplayer's face may be captured by the one camera.

The microphone 55 converts the speech of the player into a sound signal(electric signal) and outputs the sound signal to the game play terminal300. The speaker 56 converts the sound signal into a sound and outputsthe sound to the player. In another aspect, the HMD 500 may includeearphones instead of the speaker 56.

The controller 540 is connected to the game play terminal 300 in a wiredor wireless manner. The controller 540 receives as an input a commandfrom the player to the game play terminal 300. In an aspect, thecontroller 540 is configured to be capable of being gripped by theplayer. In another aspect, the controller 540 is configured to bewearable on a part of player's body or clothing. In further anotheraspect, the controller 540 may be configured to output at least one ofvibration, sound, and light in accordance with the signal sent from thegame play terminal 300. In further another aspect, the controller 540receives an operation for controlling the position and movement of anobject arranged in the virtual space, from the player.

In an aspect, the controller 540 includes a plurality of light sources.Each of the light sources is implemented, for example, by an LED thatemits infrared rays. The HMD sensor 510 has a position trackingfunction. In this case, the HMD sensor 510 reads the plurality ofinfrared rays emitted by the controller 540, and detects position andinclination of the controller 540 in the real space. In another aspect,the HMD sensor 510 may be implemented by a camera. In this case, the HMDsensor 510 can detect the position and the inclination of the controller540 by executing image analysis processing using the image informationof the controller 540 output from the camera.

The motion sensor 520 is attached to the player's hand in an aspect, anddetects movement of the player's hand. For example, the motion sensor520 detects a rotation speed of the hand and the number of rotations ofthe hand. The detected signal is sent to the game play terminal 300. Themotion sensor 520 is provided in the controller 540, for example. In anaspect, the motion sensor 520 is provided in, for example, thecontroller 540 configured to be capable of being gripped by the player.In another aspect, for safety in the real space, the controller 540 is aglove-type controller that is mounted on the player's hand not to easilyfly away. In further another aspect, a sensor not mounted on the playermay detect the movement of the player's hand. For example, a signal of acamera capturing the player may be input to the game play terminal 300as a signal representing a behavior of the player. The motion sensor 520and the game play terminal 300 are connected to each other in a wirelessmanner, for example. In the case of the wireless, a communication modeis not particularly limited, and Bluetooth or other known communicationmethods may be used, for example.

The display 530 displays the same image as the image displayed on themonitor 51. Thereby, users other than the player wearing the HMD 500 canalso view the same image like the player. The image displayed on thedisplay 530 does not have to be a three-dimensional image, and may be aright-eye image or a left-eye image. Examples of the display 530 includea liquid crystal display and an organic EL monitor.

The game play terminal 300 produces the behavior of a character to beoperated by the player, on the basis of various types of informationacquired from the respective units of the HMD 500, the controller 540,and the motion sensor 520, and controls the progress of the game. The“behavior” herein includes moving respective parts of the body, changingpostures, changing facial expressions, moving, speaking, touching andmoving the object arranged in the virtual space, and using weapons andtools gripped by the character. In other words, in the main game, as therespective parts of the player's body move, respective parts of thecharacter's body also move in the same manner as the player. In the maingame, the character speaks the contents of the speech of the player. Inother words, in the main game, the character is an avatar object thatbehaves as a player's alter ego. As an example, at least some of thecharacter's behaviors may be executed in response to an input to thecontroller 540 from the player.

In the present embodiment, the motion sensor 520 is attached to bothhands of the player, both legs of the player, a waist of the player, anda head of the player. The motion sensor 520 attached to both hands ofthe player may be provided in the controller 540 as described above. Inaddition, the motion sensor 520 attached to the head of the player maybe provided in the HMD 500. The motion sensor 520 may be furtherattached to both elbows and knees of the user. As the number of motionsensors 520 attached to the player increases, the movement of the playercan be more accurately reflected in the character. Further, the playermay wear a suit to which one or more motion sensors 520 are attached,instead of attaching the motion sensors 520 to the respective parts ofthe body. In other words, a motion capturing method is limited to anexample of using the motion sensor 520.

(Transmission Terminal 400)

The transmission terminal 400 may be a mobile terminal such as asmartphone, a PDA (Personal Digital Assistant), or a tablet computer.Further, the transmission terminal 400 may be a so-called stationaryterminal such as a desktop computer terminal.

As shown in FIG. 5, the transmission terminal 400 includes a processor40, a memory 41, a storage 42, a communication IF 43, an input/output IF44, and a touch screen 45. The transmission terminal 400 may include aninput/output IF 44 connectable to a display (display unit) configuredseparately from the main body of the transmission terminal 400, insteadof or in addition to the touch screen 45.

The controller 1021 may include one or physical input mechanisms ofbuttons, levers, sticks, and wheels. The controller 1021 sends an outputvalue based on an input operation input to the input mechanisms from theoperator (the player in the present embodiment) of the transmissionterminal 400, to the transmission terminal 400. Further, the controller1021 may include various sensors of an acceleration sensor and anangular velocity sensor, and may send the output values of the varioussensors to the transmission terminal 400. The above-described outputvalues are received by the transmission terminal 400 via thecommunication IF 43.

The transmission terminal 400 may include a camera and a ranging sensor(not shown). The controller 1021 may alternatively or additionallyinclude the camera and the ranging sensor provided in the transmissionterminal 400.

As described above, the transmission terminal 400 includes thecommunication IF 43, the input/output IF 44, and the touch screen 45 asexamples of mechanisms that input information to the transmissionterminal 400. The above-described respective components as an inputmechanism can be regarded as an operation unit configured to receive theuser's input operation.

When the operation unit is configured by the touch screen 45, thetransmission terminal 400 specifies and receives a user's operation,which is performed on an input unit 451 of the touch screen 45, as auser's input operation. Alternatively, when the operation unit isconfigured by the communication IF 43, the transmission terminal 400specifies and receives a signal (for example, an output value), which issent from the controller 1021, as a user's input operation.Alternatively, when the operation unit is configured by the input/outputIF 44, the transmission terminal 400 specifies and receives a signal,which is output from an input device (not shown) connected to theinput/output IF 44, as a user's input operation.

<Hardware Components of Each Device>

Each of the processors 10, 20, 30, and 40 controls operations of all theuser terminal 100, the server 200, the game play terminal 300, and thetransmission terminal 400. Each of the processors 10, 20, 30, and 40includes a CPU (Central Processing Unit), an MPU (Micro ProcessingUnit), and a GPU (Graphics Processing Unit). Each of the processors 10,20, 30, and 40 reads a program from each of storages 12, 22, 32, and 42which will be described below. Then, each of the processors 10, 20, 30,and 40 expands the read program to each of memories 11, 21, 31, and 41which will be described below. The processors 10, 20, and 30 execute theexpanded program.

Each of the memories 11, 21, 31, and 41 is a main storage device. Eachof the memories 11, 21, 31, and 41 is configured by storage devices of aROM (Read Only Memory) and a RAM (Random Access Memory). The memory 11temporarily stores a program and various types of data read from thestorage 12 to be described below by the processor 10 to give a work areato the processor 10. The memory 11 also temporarily stores various typesof data generated when the processor 10 is operating in accordance withthe program. The memory 21 temporarily stores a program and varioustypes of data read from the storage 22 to be described below by theprocessor 20 to give a work area to the processor 20. The memory 21 alsotemporarily stores various types of data generated when the processor 20is operating in accordance with the program. The memory 31 temporarilystores a program and various types of data read from the storage 32 tobe described below by the processor 30 to give a work area to theprocessor 30. The memory 31 also temporarily stores various types ofdata generated when the processor 30 is operating in accordance with theprogram. The memory 41 temporarily stores a program and various types ofdata read from the storage 42 to be described below by the processor 40to give a work area to the processor 40. The memory 41 also temporarilystores various types of data generated when the processor 40 isoperating in accordance with the program.

In the present embodiment, the programs to be executed by the processors10 and 30 may be game programs of the main game. In the presentembodiment, the program executed by the processor 40 may be atransmission program for implementing transmission of behaviorinstruction data. In addition, the processor 10 may further execute aviewing program for implementing the reproduction of a moving image.

In the present embodiment, the program to be executed by the processor20 may be at least one of the game program, the transmission program,and the viewing program. The processor 20 executes at least one of thegame program, the transmission program, and the viewing program inresponse to a request from at least one of the user terminal 100, thegame play terminal 300, and the transmission terminal 400. Thetransmission program and the viewing program may be executed inparallel.

In other words, the game program may be a program for implementing thegame by cooperation of the user terminal 100, the server 200, and thegame play terminal 300. The transmission program may be a programimplementing the transmission of the behavior instruction data bycooperation of the server 200 and the transmission terminal 400. Theviewing program may be a program for implementing the reproduction ofthe moving image by cooperation of the user terminal 100 and the server200.

Each of the storages 12, 22, 32, and 42 is an auxiliary storage device.Each of the storages 12, 22, 32, and 42 is configured by a storagedevice such as a flash memory or an HDD (Hard Disk Drive). Each of thestorages 12 and 32 stores various types data regarding the game, forexample. The storage 42 stores various types of data regardingtransmission of the behavior instruction data. Further, the storage 12stores various types of data regarding the reproduction of the movingimage. The storage 22 may store at least some of various types of dataregarding each of the game, the transmission of the behavior instructiondata, and the reproduction of the moving image.

Each of the communication IFs 13, 23, 33, and 43 controls the sendingand reception of various types of data in the user terminal 100, theserver 200, the game play terminal 300, and the transmission terminal400. Each of the communication IFs 13, 23, 33, and 43 controls, forexample, communication via a wireless LAN (Local Area Network), Internetcommunication via a wired LAN, a wireless LAN, or a mobile phonenetwork, and communication using short-range wireless communication.

Each of the input/output IFs 14, 24, 34, and 44 are interfaces throughwhich the user terminal 100, the server 200, the game play terminal 300,and the transmission terminal 400 receives a data input and outputs thedata. Each of the input/output IFs 14, 24, 34, and 44 may performinput/output of data via a USB (Universal Serial Bus) or the like. Eachof the input/output IFs 14, 24, 34, and 44 may include a physicalbutton, a camera, a microphone, a speaker, a mouse, a keyboard, adisplay, a stick, and a lever. Further, each of the input/output IFs 14,24, 34, and 44 may include a connection portion for sending to andreceiving from a peripheral device.

The touch screen 15 is an electronic component in which the input unit151 and the display unit 152 (display) are combined. The touch screen 45is an electronic component in which the input unit 451 and the displayunit 452 are combined. Each of the input units 151 and 451 is, forexample, a touch-sensitive device, and is configured by a touch pad, forexample. Each of the display units 152 and 452 is configured by a liquidcrystal display or an organic EL (Electro-Luminescence) display, forexample.

Each of the input units 151 and 451 has a function of detecting aposition where user's operations (mainly, physical contact operationsincluding a touch operation, a slide operation, a swipe operation, and atap operation) are input to an input surface, and sending informationindicating the position as an input signal. Each of the input units 151and 451 includes a touch sensor (not shown). The touch sensor may adoptany one of methods such as a capacitive touch method and aresistive-film touch method.

Although not shown, the user terminal 100 and the transmission terminal400 may include one or more sensors configured to specify a holdingposture of the user terminal 100 and a holding posture of thetransmission terminal 400, respectively. The sensor may be, for example,an acceleration sensor or an angular velocity sensor.

When each of the user terminal 100 and the transmission terminal 400includes a sensor, the processors 10 and 40 can specify the holdingposture of the user terminal 100 and the holding posture of thetransmission terminal 400 from the outputs of the sensors, respectively,and can perform processing depending on the holding postures. Forexample, when the processors 10 and 40 may be vertical screen displaysin which a vertically long images are displayed on the display units 152and 452 when the user terminal 100 and the transmission terminal 400 areheld in a vertical direction, respectively. On the other hand, when theuser terminal 100 and the transmission terminal 400 are heldhorizontally, a horizontally long image may be displayed on the displayunit as a horizontal screen display. In this way, the processors 10 and40 may be able to switch between a vertical screen display and ahorizontal screen display depending on the holding postures of the userterminal 100 and the transmission terminal 400, respectively.

<Functional Configuration of System 1>

FIG. 6 is a block diagram showing functional configurations of the userterminal 100, the server 200, and the HMD set 1000 included in thesystem 1. FIG. 7 is a block diagram showing a functional configurationof the transmission terminal 400 shown in FIG. 6.

The user terminal 100 has a function as an input device that receives auser's input operation, and a function as an output device that outputsan image or a sound of the game. The user terminal 100 functions as acontrol unit 110 and a storage unit 120 by cooperation of the processor10, the memory 11, the storage 12, the communication IF 13, theinput/output IF 14, and the touch screen 15.

The server 200 has a function of mediating the sending and reception ofvarious types of information between the user terminal 100, the HMD set1000, and the transmission terminal 400. The server 200 functions as acontrol unit 210 and a storage unit 220 by cooperation of the processor20, the memory 21, the storage 22, the communication IF 23, and theinput/output IF 24.

The HMD set 1000 (the game play terminal 300) has a function as an inputdevice that receives a player's input operation, a function as an outputdevice that outputs an image and a sound of the game, and a function ofsending game progress information to the user terminal 100 via theserver 200 in real time. The HMD set 1000 functions as a control unit310 and a storage unit 320 by cooperation of the processor 30, thememory 31, the storage 32, the communication IF 33, and the input/outputIF 34 of the game play terminal 300 with the HMD 500, the HMD sensor510, the motion sensor 520, and the controller 540.

The transmission terminal 400 has a function of generating behaviorinstruction data and sending the behavior instruction data to the userterminal 100 via the server 200. The transmission terminal 400 functionsas a control unit 410 and a storage unit 420 by cooperation of theprocessor 40, the memory 41, the storage 42, the communication IF 43,the input/output IF 44, and the touch screen 45.

(Data Stored in Storage Unit of Each Device)

The storage unit 120 stores a game program 131 (a program), gameinformation 132, and user information 133. The storage unit 220 stores agame program 231, game information 232, user information 233, and a userlist 234. The storage unit 320 stores a game program 331, gameinformation 332, and user information 333. The storage unit 420 stores auser list 421, a motion list 422, and a transmission program 423 (aprogram, a second program).

The game programs 131, 231, and 331 are game programs to be executed bythe user terminal 100, the server 200, and the HMD set 1000,respectively. The respective devices operates by cooperation based onthe game programs 131, 231, and 331, and thus the main game isimplemented. The game programs 131 and 331 may be stored in the storageunit 220 and downloaded to the user terminal 100 and the HMD set 1000,respectively. In the present embodiment, the user terminal 100 performsrendering on the data received from the transmission terminal 400 inaccordance with the game program 131 and reproduces a moving image. Inother words, the game program 131 is also a program for reproducing themoving image using moving image instruction data transmitted from thetransmission terminal 400. The program for reproducing the moving imagemay be different from the game program 131. In this case, the storageunit 120 stores a program for reproducing the moving image separatelyfrom the game program 131.

The game information 132, 232, and 332 are data used for reference whenuser terminal 100, the server 200, and the HMD set 1000 execute the gameprograms, respectively. Each of the user information 133, 233, and 333is data regarding a user's account of the user terminal 100. The gameinformation 232 is the game information 132 of each of the userterminals 100 and the game information 332 of the HMD set 1000. The userinformation 233 is the user information 133 of each of the userterminals 100 and player's user information included in the userinformation 333. The user information 333 is the user information 133 ofeach of the user terminals 100 and player's user information.

Each of the user list 234 and the user list 421 is a list of users whohave participated in the game. Each of the user list 234 and the userlist 421 may include not only a list of users who have participated inthe most recent game play by the player but also a list of users whohave participated in each of game plays before the most recent gameplay. The motion list 422 is a list of a plurality of motion datacreated in advance. The motion list 422 is, for example, a list in whichmotion data is associated with information (for example, a motion name)identifies each motion. The transmission program 423 is a program forimplementing transmission of the behavior instruction data forreproducing the moving image on the user terminal 100 to the userterminal 100.

(Functional Configuration of Server 200)

The control unit 210 comprehensively controls the server 200 byexecuting the game program 231 stored in the storage unit 220. Forexample, the control unit 210 mediates the sending and reception ofvarious types of information between the user terminal 100, the HMD set1000, and the transmission terminal 400.

The control unit 210 functions as a communication mediator 211, a loggenerator 212, and a list generator 213 in accordance with thedescription of game program 231. The control unit 210 can also as otherfunctional blocks (not shown) for the purpose of mediating the sendingand reception of various types of information regarding the game playand transmission of the behavior instruction data and supporting theprogress of the game.

The communication mediator 211 mediates the sending and reception ofvarious types of information between the user terminal 100, the HMD set1000, and the transmission terminal 400. For example, the communicationmediator 211 sends the game progress information received from the HMDset 1000 to the user terminal 100. The game progress informationincludes data indicating information on movement of the characteroperated by the player, parameters of the character, and items andweapons possessed by the character, and enemy characters. The server 200sends the game progress information to the user terminal 100 of all theusers who participate in the game. In other words, the server 200 sendscommon game progress information to the user terminal 100 of all theusers who participate in the game. Thereby, the game progresses in eachof the user terminals 100 of all the users who participate in the gamein the same manner as in the HMD set 1000.

Further, for example, the communication mediator 211 sends informationreceived from any one of the user terminals 100 to support the progressof the game by the player, to the other user terminals 100 and the HMDset 1000. As an example, the information may be an item for the playerto carry on the game advantageously, and may be item informationindicating an item provided to the player (character). The iteminformation includes information (for example, a user name and a userID) indicating the user who provides the item. Further, thecommunication mediator 211 may mediate the transmission of the behaviorinstruction data from the transmission terminal 400 to the user terminal100.

The log generator 212 generates a log for the game progress based on thegame progress information received from the HMD set 1000. The listgenerator 213 generates the user list 234 after the end of the gameplay. Although details will be described below, each user in the userlist 234 is associated with a tag indicating the content of the supportprovided to the player by the user. The list generator 213 generates atag based on the log for the game progress generated by the loggenerator 212, and associates it with the corresponding user. The listgenerator 213 may associate the content of the support, which is inputby the game operator or the like using a terminal device such as apersonal computer and provided to the player by each user, with thecorresponding user, as a tag. Thereby, the content of the supportprovided by each user becomes more detailed. The user terminal 100sends, based on the user's operation, the information indicating theuser to the server 200 when the users participate in the game. Forexample, the user terminal 100 sends a user ID, which is input by theuser, to the server 200. In other words, the server 200 holdsinformation indicating each user for all the users who participate inthe game. The list generator 213 may generate, using the information,the user list 234.

(Functional Configuration of HMD Set 1000)

The control unit 310 comprehensively controls the HMD set 1000 byexecuting the game program 331 stored in the storage unit 320. Forexample, the control unit 310 allows the game to progress in accordancewith the game program 331 and the player's operation. In addition, thecontrol unit 310 communicates with the server 200 to send and receiveinformation as needed while the game is in progress. The control unit310 may send and receive the information directly to and from the userterminal 100 without using the server 200.

The control unit 310 functions as an operation receiver 311, a displaycontroller 312, a UI controller 313, an animation generator 314, a gamecoordinator 315, a virtual space controller 316, and a responseprocessor 317 in accordance with the description of the game program331. The control unit 310 can also as other functional blocks (notshown) for the purpose of controlling characters appearing in the game,depending on the nature of the game to be executed.

The operation receiver 311 detects and receives the player's inputoperation. The operation receiver 311 receives signals input from theHMD 500, the motion sensor 520, and the controller 540, determines whatkind of input operation has been performed, and outputs the result toeach component of the control unit 310.

The UI controller 313 controls user interface (hereinafter, referred toas UI) images to be displayed on the monitor 51 and the display 530. TheUI image is a tool for the player to make an input necessary for theprogress of the game to the HMD set 1000, or a tool for obtaininginformation, which is output during the progress of the game, from theHMD set 1000. The UI image is not limited thereto, but includes icons,buttons, lists, and menu screens, for example.

The animation generator 314 generates, based on control modes of variousobjects, animations showing motions of various objects. For example, theanimation generator 314 may generate an animation that expresses a statewhere an object (for example, a player's avatar object) moves as if itis there, its mouth moves, or its facial expression changes.

The game coordinator 315 controls the progress of the game in accordancewith the game program 331, the player's input operation, and thebehavior of the avatar object corresponding to the input operation. Forexample, the game coordinator 315 performs predetermined game processingwhen the avatar object performs a predetermined behavior. Further, forexample, the game coordinator 315 may receive information indicating theuser's operation on the user terminal 100, and may perform gameprocessing based on the user's operation. In addition, the gamecoordinator 315 generates game progress information depending on theprogress of the game, and sends the generated information to the server200. The game progress information is sent to the user terminal 100 viathe server 200. Thereby, the progress of the game in the HMD set 1000 isshared in the user terminal 100. In other words, the progress of thegame in the HMD set 1000 synchronizes with the progress of the game inthe user terminal 100.

The virtual space controller 316 performs various controls related tothe virtual space provided to the player, depending on the progress ofthe game. As an example, the virtual space controller 316 generatesvarious objects, and arranges the objects in the virtual space. Further,the virtual space controller 316 arranges a virtual camera in thevirtual space. In addition, the virtual space controller 316 producesthe behaviors of various objects arranged in the virtual space,depending on the progress of the game. Further, the virtual spacecontroller 316 controls the position and inclination of the virtualcamera arranged in the virtual space, depending on the progress of thegame.

The display controller 312 outputs a game screen reflecting theprocessing results executed by each of the above-described components tothe monitor 51 and the display 530. The display controller 312 maydisplay an image based on a field of view from the virtual cameraarranged in the virtual space, on the monitor 51 and the display 530 asa game screen. Further, the display controller 312 may include theanimation generated by the animation generator 314 in the game screen.Further, the display controller 312 may draw the above-described UIimage, which is controlled by the UI controller 313, in a manner ofbeing superimposed on the game screen.

The response processor 317 receives a feedback regarding a response ofthe user of the user terminal 100 to the game play of the player, andoutputs the feedback to the player. In the present embodiment, forexample, the user terminal 100 can create, based on the user's inputoperation, a comment (message) directed to the avatar object. Theresponse processor 317 receives comment data of the comment and outputsthe comment data. The response processor 317 may display text datacorresponding to the comment of the user on the monitor 51 and thedisplay 530, or may output sound data corresponding to the comment ofthe user from a speaker (not shown). In the former case, the responseprocessor 317 may draw an image corresponding to the text data (that is,an image including the content of the comment) in a manner of beingsuperimposed on the game screen.

(Functional Configuration of User Terminal 100)

The control unit 110 comprehensively controls the user terminal 100 byexecuting the game program 131 stored in the storage unit 120. Forexample, the control unit 110 controls the progress of the game inaccordance with the game program 131 and the user's operation. Inaddition, the control unit 110 communicates with the server 200 to sendand receive information as needed while the game is in progress. Thecontrol unit 110 may send and receive the information directly to andfrom the HMD set 1000 without using the server 200.

The control unit 110 functions as an operation receiver 111, a displaycontroller 112, a UI controller 113, an animation generator 114, a gamecoordinator 115, a virtual space controller 116, and a moving imagereproducer 117 in accordance with the description of the game program131. The control unit 110 can also as other functional blocks (notshown) for the purpose of progressing the game, depending on the natureof the game to be executed.

The operation receiver 111 detects and receives the user's inputoperation with respect to the input unit 151. The operation receiver 111determines what kind of input operation has been performed from theaction exerted by the user on a console via the touch screen 15 andanother input/output IF 14, and outputs the result to each component ofthe control unit 110.

For example, the operation receiver 111 receives an input operation forthe input unit 151, detects coordinates of an input position of theinput operation, and specifies a type of the input operation. Theoperation receiver 111 specifies, for example, a touch operation, aslide operation, a swipe operation, and a tap operation as the type ofthe input operation. Further, the operation receiver 111 detects thatthe contact input is released from the touch screen 15 when thecontinuously detected input is interrupted.

The UI controller 113 controls a UI image to be displayed on the displayunit 152 to construct a UI according to at least one of the user's inputoperation and the received game progress information. The UI image is atool for the user to make an input necessary for the progress of thegame to the user terminal 100, or a tool for obtaining information,which is output during the progress of the game, from the user terminal100. The UI image is not limited thereto, but includes icons, buttons,lists, and menu screens, for example.

The animation generator 114 generates, based on control modes of variousobjects, animations showing motions of various objects.

The game coordinator 115 controls the progress of the game in accordancewith the game program 131, the received game progress information, andthe user's input operation. When predetermined processing is performedby the user's input operation, the game coordinator 115 sendsinformation on the game processing to the HMD set 1000 via the server200. Thereby, the predetermined game processing is shared in the HMD set1000. In other words, the progress of the game in the HMD set 1000synchronizes with the progress of the game in the user terminal 100. Thepredetermined game processing is, for example, processing of providingan item to an avatar object, and in this example, information on thegame processing is the item information described above.

The virtual space controller 116 performs various controls related tothe virtual space provided to the user, depending on the progress of thegame. As an example, the virtual space controller 116 generates variousobjects, and arranges the objects in the virtual space. Further, thevirtual space controller 116 arranges a virtual camera in the virtualspace. In addition, the virtual space controller 116 produces thebehaviors of the various objects arranged in the virtual space,depending on the progress of the game, specifically, depending on thereceived game progress information. Further, the virtual spacecontroller 316 controls position and inclination of the virtual cameraarranged in the virtual space, depending on the progress of the game,specifically, the received game progress information.

The display controller 112 outputs a game screen reflecting theprocessing results executed by each of the above-described components tothe display unit 152. The display controller 112 may display an imagebased on a field of view from the virtual camera arranged in the virtualspace provided to the user, on the display unit 152 as a game screen.Further, the display controller 112 may include the animation generatedby the animation generator 114 in the game screen. Further, the displaycontroller 112 may draw the above-described UI image, which iscontrolled by the UI controller 113, in a manner of being superimposedon the game screen. In any case, the game screen displayed on thedisplay unit 152 is the game screen as the game screen displayed on theother user terminal 100 and the HMD set 1000.

The moving image reproducer 117 performs analysis (rendering) on thebehavior instruction data received from the transmission terminal 400,and reproduces the moving image.

(Functional Configuration of Transmission Terminal 400)

The control unit 410 comprehensively controls the transmission terminal400 by executing a program (not shown) stored in the storage unit 420.For example, the control unit 410 generates behavior instruction data inaccordance with the program and the operation of the user (the player inthe present embodiment) of the transmission terminal 400, and transmitsthe generated data to the user terminal 100. Further, the control unit410 communicates with the server 200 to send and receive information asneeded. The control unit 410 may send and receive the informationdirectly to and from the user terminal 100 without using the server 200.

The control unit 410 functions as a communication controller 411, adisplay controller 412, an operation receiver 413, a sound receiver 414,a motion specifier 415, and a behavior instruction data generator 416 inaccordance with the description of the program. The control unit 410 canalso function as other functional blocks (not shown) for the purpose ofgenerating and transmitting behavior instruction data.

The communication controller 411 controls the sending and reception ofinformation to and from the server 200 or the user terminal 100 via theserver 200. The communication controller 411 receives the user list 421from the server 200 as an example. Further, the communication controller411 sends the behavior instruction data to the user terminal 100 as anexample.

The display controller 412 outputs various screens, which reflectsresults of the processing executed by each component, to the displayunit 452. The display controller 412 displays a screen including thereceived user list 234 as an example. Further, as an example, thedisplay controller 412 displays a screen including the motion list 422for enabling the player to select motion data included in the behaviorinstruction data to be transmitted for use in production of the behaviorof an avatar object.

The operation receiver 413 detects and receives the player's inputoperation with respect to the input unit 151. The operation receiver 111determines what kind of input operation has been performed from theaction exerted by the user on a console via the touch screen 45 andanother input/output IF 44, and outputs the result to each component ofthe control unit 410.

For example, the operation receiver 413 receives an input operation forthe input unit 451, detects coordinates of an input position of theinput operation, and specifies a type of the input operation. Theoperation receiver 413 specifies, for example, a touch operation, aslide operation, a swipe operation, and a tap operation as the type ofthe input operation. Further, the operation receiver 413 detects thatthe contact input is released from the touch screen 45 when thecontinuously detected input is interrupted.

The sound receiver 414 receives a sound generated around thetransmission terminal 400, and generates sound data of the sound. As anexample, the sound receiver 414 receives a sound output by the playerand generates sound data of the sound.

The motion specifier 415 specifies the motion data selected by theplayer from the motion list 422 in accordance with the player's inputoperation.

The behavior instruction data generator 416 generates behaviorinstruction data. As an example, the behavior instruction data generator416 generates behavior instruction data including the generated sounddata and the specified motion data.

The functions of the HMD set 1000, the server 200, and the user terminal100 shown in FIG. 6 and the function of the transmission terminal 400shown in FIG. 7 are merely examples. Each of the HMD set 1000, theserver 200, the user terminal 100, and the transmission terminal 400 mayhave at least some of functions provided by other devices. Further,another device other than the HMD set 1000, the server 200, the userterminal 100, and the transmission terminal 400 may be used as acomponent of the system 1, and another device may be made to executesome of the processing in the system 1. In other words, the computer,which executes the game program in the present embodiment, may be any ofthe HMD set 1000, the server 200, the user terminal 100, thetransmission terminal 400, and other devices, or may be implemented by acombination of these plurality of devices.

<Control Processing of Virtual Space>

FIG. 8 is a flowchart showing an example of a flow of control processingof the virtual space provided to the player and the virtual spaceprovided to the user of the user terminal 100. FIGS. 9A and 9B arediagrams showing a virtual space 600A provided to the player and afield-of-view image visually recognized by the player according to anembodiment. FIGS. 10A and 10B are diagrams showing a virtual space 600Bprovided to the user of the user terminal 100 and a field-of-view imagevisually recognized by the user according to an embodiment. Hereinafter,the virtual spaces 600A and 600B are described as “virtual spaces 600”when being not necessary to be distinguished from each other.

In step S1, the processor 30 functions as the virtual space controller316 to define the virtual space 600A shown in FIG. 9A. The processor 30defines the virtual space 600A using virtual space data (not shown). Thevirtual space data may be stored in the game play terminal 300, may begenerated by the processor 30 in accordance with the game program 331,or may be acquired by the processor 30 from the external device such asthe server 200.

As an example, the virtual space 600 has an all-celestial spherestructure that covers the entire sphere in a 360-degree direction arounda point defined as a center. In FIGS. 9A and 10A, an upper half of thevirtual space 600 is illustrated as a celestial sphere not to complicatethe description.

In step S2, the processor 30 functions as the virtual space controller316 to arrange an avatar object (character) 610 in the virtual space600A. The avatar object 610 is an avatar object associated with theplayer, and behaves in accordance with the player's input operation.

In step S3, the processor 30 functions as the virtual space controller316 to arrange other objects in the virtual space 600A. In the exampleof FIGS. 9A and 9B, the processor 30 arranges objects 631 to 634.Examples of other objects may include character objects (so-callednon-player characters, NPC) that behaves in accordance with the gameprogram 331, operation objects such as virtual hands, and objects thatimitate animals, plants, artificial objects, or natural objects that arearranged depending on the progress of the game.

In step S4, the processor 30 functions as the virtual space controller316 to arrange a virtual camera 620A in the virtual space 600A. As anexample, the processor 30 arranges the virtual camera 620A at a positionof the head of the avatar object 610.

In step S5, the processor 30 displays a field-of-view image 650 on themonitor 51 and the display 530. The processor 30 defines a field-of-viewarea 640A, which is a field of view from the virtual camera 620A in thevirtual space 600A, in accordance with an initial position and aninclination of the virtual camera 620A. Then, the processor 30 defines afield-of-view image 650 corresponding to the field-of-view area 640A.The processor 30 outputs the field-of-view image 650 to the monitor 51and the display 530 to allow the HMD 500 and the display 530 to displaythe field-of-view image 650.

In the example of FIGS. 9A and 9B, as shown in FIG. 9A, since a part ofthe object 634 is included in the field-of-view area 640A, thefield-of-view image 650 includes a part of the object 634 as shown inFIG. 9B.

In step S6, the processor 30 sends initial arrangement information tothe user terminal 100 via the server 200. The initial arrangementinformation is information indicating initial arrangement positions ofvarious objects in the virtual space 600A. In the example of FIGS. 9Aand 9B, the initial arrangement information includes information oninitial arrangement positions of the avatar object 610 and the objects631 to 634. The initial arrangement information can also be expressed asone of the game progress information.

In step S7, the processor 30 functions as the virtual space controller316 to control the virtual camera 620A depending on the movement of theHMD 500. Specifically, the processor 30 controls the direction andinclination of the virtual camera 620A depending on the movement of theHMD 500, that is, the posture of the head of the player. As will bedescribed below, the processor 30 moves the head of the player (changesthe posture of the head) and moves a head of the avatar object 610 inaccordance with such movement. The processor 30 controls the directionand inclination of the virtual camera 620A such that a direction of theline of sight of the avatar object 610 coincides with a direction of theline of sight of the virtual camera 620A. In step S8, the processor 30updates the field-of-view image 650 in response to changes in thedirection and inclination of the virtual camera 620A.

In step S9, the processor 30 functions as the virtual space controller316 to move the avatar object 610 depending on the movement of theplayer. As an example, the processor 30 moves the avatar object 610 inthe virtual space 600A as the player moves in the real space. Further,the processor 30 moves the head of the avatar object 610 in the virtualspace 600A as the head of the player moves in the real space.

In step S10, the processor 30 functions as the virtual space controller316 to move the virtual camera 620A to follow the avatar object 610. Inother words, the virtual camera 620A is always located at the head ofthe avatar object 610 even when the avatar object 610 moves.

The processor 30 updates the field-of-view image 650 depending on themovement of the virtual camera 620A. In other words, the processor 30updates the field-of-view area 640A depending on the posture of the headof the player and the position of the virtual camera 620A in the virtualspace 600A. As a result, the field-of-view image 650 is updated.

In step S11, the processor 30 sends the behavior instruction data of theavatar object 610 to the user terminal 100 via the server 200. Thebehavior instruction data herein includes at least one of motion datathat takes the motion of the player during a virtual experience (forexample, during a game play), sound data of a sound output by theplayer, and operation data indicating the content of the input operationto the controller 540. When the player is playing the game, the behaviorinstruction data is sent to the user terminal 100 as game progressinformation, for example.

Processes of steps S7 to S11 are consecutively and repeatedly executedwhile the player is playing the game.

In step S21, the processor 10 of the user terminal 100 of a user 3functions as the virtual space controller 116 to define a virtual space600B shown in FIG. 10A. The processor 10 defines a virtual space 600Busing virtual space data (not shown). The virtual space data may bestored in the user terminal 100, may be generated by the processor 10based on the game program 131, or may be acquired by the processor 10from an external device such as the server 200.

In step S22, the processor 10 receives initial arrangement information.In step S23, the processor 10 functions as the virtual space controller116 to arrange various objects in the virtual space 600B in accordancewith the initial arrangement information. In the example of FIGS. 10Aand 10B, various objects are an avatar object 610 and objects 631 to634.

In step S24, the processor 10 functions as the virtual space controller116 to arrange a virtual camera 620B in the virtual space 600B. As anexample, the processor 10 arranges the virtual camera 620B at theposition shown in FIG. 10A.

In step S25, the processor 10 displays a field-of-view image 660 on thedisplay unit 152. The processor 10 defines a field-of-view area 640B,which is a field of view from the virtual camera 620B in the virtualspace 600B, in accordance with an initial position and an inclination ofthe virtual camera 620B. Then, the processor 10 defines a field-of-viewimage 660 corresponding to the field-of-view area 640B. The processor 10outputs the field-of-view image 660 to the display unit 152 to allow thedisplay unit 152 to display the field-of-view image 660.

In the example of FIGS. 10A and 10B, since the avatar object 610 and theobject 631 are included in the field-of-view area 640B as shown in FIG.10A, the field-of-view image 660 includes the avatar object 610 and theobject 631 as shown in FIG. 10B.

In step S26, the processor 10 receives the behavior instruction data. Instep S27, the processor 10 functions as the virtual space controller 116to move the avatar object 610 in the virtual space 600B in accordancewith the behavior instruction data. In other words, the processor 10reproduces a video in which the avatar object 610 is behaving, byreal-time rendering.

In step S28, the processor 10 functions as the virtual space controller116 to control the virtual camera 620B in accordance with the user'soperation received when functioning as the operation receiver 111. Instep S29, the processor 10 updates the field-of-view image 660 dependingon changes in the position of the virtual camera 620B in the virtualspace 600B and the direction and inclination of the virtual camera 620B.In step S28, the processor 10 may automatically control the virtualcamera 620B depending on the movement of the avatar object 610, forexample, the change in the movement and direction of the avatar object610. For example, the processor 10 may automatically move the virtualcamera 620B or change its direction and inclination such that the avatarobject 610 is always captured from the front. As an example, theprocessor 10 may automatically move the virtual camera 620B or changeits direction and inclination such that the avatar object 610 is alwayscaptured from the rear in response to the movement of the avatar object610.

As described above, the avatar object 610 behaves in the virtual space600A depending on the movement of the player. The behavior instructiondata indicating the behavior is sent to the user terminal 100. In thevirtual space 600B, the avatar object 610 behaves in accordance with thereceived behavior instruction data. Thereby, the avatar object 610performs the same behavior in the virtual space 600A and the virtualspace 600B. In other words, the user 3 can visually recognize thebehavior of the avatar object 610 depending on the behavior of theplayer using the user terminal 100.

<Overview of Game>

FIGS. 11A to 11D are diagrams showing another example of thefield-of-view image displayed on the user terminal 100. Specifically,FIG. 11 is a diagram showing an example of a game screen of a game (maingame) to be executed by the system 1 in which the player is playing.

The main game is a game in which the avatar object 610 who operatesweapons, for example, guns and knives and a plurality of enemy objects671 who is NPC appear in the virtual space 600 and the avatar object 610fights against the enemy objects 671. Various game parameters, forexample, a physical strength of the avatar object 610, the number ofusable magazines, the number of remaining bullets of the gun, and thenumber of remaining enemy objects 671 are updated depending on theprogress of the game.

A plurality of stages are prepared in the main game, and the player canclear the stage by establishing predetermined achievement conditionsassociated with each stage. Examples of the predetermined achievementconditions may include conditions established by defeating all theappearing enemy objects 671, defeating a boss object among the appearingenemy objects 671, acquiring a predetermined item, and reaching apredetermined position. The achievement conditions are defined in thegame program 131. In the main game, the player clears the stage when theachievement conditions are established depending on the content of thegame, in other words, a win of the avatar object 610 against the enemyobjects 671 (win or loss between the avatar object 610 and the enemyobject 671) is determined. On the other hand, for example, when the gameexecuted by the system 1 is a racing game, the ranking of the avatarobject 610 is determined when a condition is established that the avatarobject reaches a goal.

In the main game, the game progress information is live transmitted tothe plurality of user terminals 100 at predetermined time intervals inorder to share the virtual space between the HMD set 1000 and theplurality of user terminals 100. As a result, on the touch screen 15 ofthe user terminal 100 on which the user watches the game, afield-of-view image of the field-of-view area defined by the virtualcamera 620B corresponding to the user terminal 100 is displayed.Further, on an upper right side and an upper left side of thefield-of-view image, parameter images showing the physical strength ofthe avatar object 610, the number of usable magazines, the number ofremaining bullets of the gun, and the number of remaining enemy objects671 are displayed in a manner of being superimposed. The field-of-viewimage can also be expressed as a game screen.

As described above, the game progress information includes motion datathat takes the behavior of the player, sound data of a sound output bythe player, and operation data indicating the content of the inputoperation to the controller 540. These data are, that is, informationfor specifying the position, posture, and direction of the avatar object610, information for specifying the position, posture, and direction ofthe enemy object 671, and information for specifying the position ofother objects (for example, obstacle objects 672 and 673). The processor10 specifies the position, posture, and direction of each object byanalyzing (rendering) the game progress information.

The game information 132 includes data of various objects, for example,the avatar object 610, the enemy object 671, and the obstacle objects672 and 673. The processor 10 uses the data and the analysis result ofthe game progress information to update the position, posture, anddirection of each object. Thereby, the game progresses, and each objectin the virtual space 600B moves in the same manner as each object in thevirtual space 600A. Specifically, in the virtual space 600B, each objectincluding the avatar object 610 behaves in accordance with the gameprogress information regardless of whether the user operates the userterminal 100.

On the touch screen 15 of the user terminal 100, as an example, UIimages 701 and 702 are displayed in a manner of being superimposed onthe field-of-view image. The UI image 701 is a UI image that receives anoperation for controlling the touch screen 15 to display a UI image 711that receives an item-supply operation for supporting the avatar object610 from the user 3. The UI image 702 is a UI image that receives anoperation for controlling the touch screen 15 to display a UI image (tobe described below) receives an operation for inputting and sending acomment for the avatar object 610 (in other words, a player 4) from theuser 3. The operation received by the UI images 701 and 702 may be, forexample, an operation of tapping the UI images 701 and 702.

When the UI image 701 is tapped, the UI image 711 is displayed in amanner of being superimposed on the field-of-view image. The UI image711 includes, for example, a UI image 711A on which a magazine icon isdrawn, a UI image 711B on which a first-aid kit icon is drawn, a UIimage 711C on which a triangular cone icon is drawn, and a UI image 711Don which a barricade icon is drawn. The item-supply operationcorresponds to an operation of tapping any UI image, for example.

As an example, when the UI image 711A is tapped, the number of remainingbullets of the gun used by the avatar object 610 increases. When the UIimage 711B is tapped, the physical strength of the avatar object 610 isrestored. When the UI images 711C and 711D are tapped, the obstacleobjects 672 and 673 are arranged in the virtual space to obstruct themovement of the enemy object 671. One of the obstacle objects 672 and673 may obstruct the movement of the enemy object 671 more than theother obstacle object.

The processor 10 sends item-supply information indicating that theitem-supply operation has been performed, to the server 200. Theitem-supply information includes at least information for specifying atype of the item specified by the item-supply operation. The item-supplyinformation may include another information on the item such asinformation indicating a position where the item is arranged. Theitem-supply information is sent to another user terminal 100 and the HMDset 1000 via the server 200.

FIGS. 12A to 12D are diagrams showing another example of thefield-of-view image displayed on the user terminal 100. Specifically,FIG. 12 is a diagram showing an example of a game screen of the maingame, and is a diagram for illustrating a communication between theplayer and user terminal 100 during the game play.

In a case of FIG. 12A, the user terminal 100 produces a speech 691 ofthe avatar object 610. Specifically, the user terminal 100 produces thespeech 691 of the avatar object 610 on the basis of the sound dataincluded in the game progress information. The content of the speech 691is “OUT OF BULLETS!” output by a player 4. In other words, the contentof the speech 691 is to inform each user that there is no magazine (0)and the number of bullets loaded in the gun is 1, so that a means forattacking the enemy object 671 is likely to be lost.

In FIG. 12A, a balloon is used to visually indicate the speech of theavatar object 610, but the sound is output by the speaker of the userterminal 100 in fact. In addition to the output of the sound, theballoon shown in FIG. 12A (that is, the balloon including a text of thesound content) may be displayed in the field-of-view image. This alsoapplies to a speech 692 to be described below.

Upon reception of the tap operation on the UI image 702, the userterminal 100 displays UI images 705 and 706 (message UI) in a manner ofbeing superimposed on the field-of-view image as shown in FIG. 12B. TheUI image 705 is a UI image on which a comment on the avatar object 610(in other words, the player) is displayed. The UI image 706 is a UIimage that receives a comment-sending operation from the user 3 in orderto send the input comment.

As an example, upon reception of the tap operation on the UI image 705,the user terminal 100 controls the touch screen 15 to display a UI image(not shown, hereinafter simply referred to as “keyboard”) imitating akeyboard. The user terminal 100 controls the UI image 705 to display atext corresponding to the user's input operation on the keyboard. In theexample of FIG. 12B, the text “I'll SEND YOU A MAGAZINE” is displayed onthe UI image 705.

As an example, upon reception of the tap operation on the UI image 706after the text is input, the user terminal 100 sends comment informationincluding information indicating the input content (text content) andinformation indicating the user, to the server 200. The commentinformation is sent to another user terminal 100 and HMD set 1000 viathe server 200.

A UI image 703A is a UI image indicating a user name of the user whosends the comment, and a UI image 704A is a UI image indicating acontent of the comment sent by the user. In the example of FIG. 12B, auser with the user name “BBBBB” uses his/her own user terminal 100 tosend comment information having the content “watch out!”, whereby the UIimage 703A and the UI image 704A are displayed. The UI image 703A andthe UI image 704A are displayed on the touch screen 15 of all the userterminals 100 participating in the main game and the monitor 51 of theHMD 500. The UI image 703A and the 704A may be one UI image. In otherwords, one UI image may include the user name and the content of thecomment.

In an example of FIG. 12C, a user with the user name “AAAAA”, who is theuser of the user terminal 100 shown in FIGS. 12A to 12D, inputs andsends a comment as described above, whereby UI images 703B and 704B aredisplayed on the touch screen 15. The UI image 703B contains the username “AAAAA”, and the UI image 704B contains the comment “I'll SEND YOUA MAGAZINE!” input in the example of FIG. 12B.

Further, the example of FIG. 12C shows a field-of-view image 611 inwhich the user “AAAAA” further inputs a tap operation to the UI image701 and displays the UI image 711 on the touch screen 15 and the inputof the tap operation to the UI image 711A is completed. In other words,item-supply information indicating a magazine is sent from the userterminal 100 of the user “AAAAA” to another user terminal 100 and theHMD set 1000, and as a result, the user terminal 100 and the HMD set1000 arrange a presentment object 674 (to be described below) in thevirtual space 600. As an example, the user terminal 100 and the HMD set1000 executes a presentment related to the presentment object 674 afterthe elapsed time indicated in the item-supply information has elapsed,and executes processing of arousing the effect of the item object.

In an example of FIG. 12D, the number of magazines is increased from 0to 1 by execution of the processing of arousing the effect of the itemobject. As a result, the player speaks the phrase “thank you!” to theuser “AAAAA”, and sound data of the speech is sent to each of the userterminals 100. Thereby, each of the user terminals 100 outputs the sound“than you!” as a speech 692 of the avatar object 610.

As described above, the communication between the user and the avatarobject 610 is achieved in the main game by both the input of the commentof each user and the output of the speech sound of the avatar object 610based on the speech of the player.

(Game Progress Processing in Game Play Terminal 300)

FIG. 13 is a flowchart showing an example of a flow of game progressprocessing to be executed by the game play terminal 300.

In step S31, the processor 30 functions as the game coordinator 315 tocontrol the progress of the game in accordance with the game program 331and the movement of the player. In step S32, the processor 30 generatesgame progress information and transmits the generated information touser terminal 100. Specifically, the processor 30 sends the generatedgame progress information to each of the user terminals 100 via theserver 200.

In step S33, upon receiving item-supply information (YES in S33), theprocessor 30 arranges item objects in the virtual space 600A based onthe item-supply information in step S34. As an example, the processor 30arranges the presentment object 674 in the virtual space 600A before thearrangement of the item objects (see FIG. 11C). The presentment object674 may be, for example, an object imitating a present box. As anexample, the processor 30 may execute the presentment related to thepresentment object 674 after the elapsed time indicated in theitem-supply information has elapsed. The presentment may be, forexample, an animation in which a lid of the present box opens. Theprocessor 30 executes processing for arousing the effect of the itemobject after executing the animation. For example, in the example ofFIG. 11D, the obstacle object 673 is arranged.

The processor 30 may arrange the item object corresponding to the tappedUI image in the virtual space 600A after executing the animation. Forexample, when a tap operation is performed on the UI image 711A, theprocessor 30 arranges the magazine object indicating the magazine in thevirtual space 600A after executing the animation. In addition, when atap operation is performed on the UI image 711B, the processor 30arranges the first-aid kit object indicating the first-aid kit in thevirtual space 600A after executing the animation. The processor 30 mayexecute the processing of arousing the effect of the magazine object orthe first-aid kit object when the avatar object 610 moves to theposition of the magazine object or the first-aid kit object, forexample.

The processor 30 continues and repeats the processes of steps S31 to S34until the game is over. When the game is over, for example, when theplayer inputs a predetermined input operation for the end of the game(YES in step S35), the processing shown in FIG. 13 ends.

(Game Progress Processing in User Terminal 100)

FIG. 14 is a flowchart showing an example of a flow of game progressprocessing to be executed by the user terminal 100.

In step S41, the processor 10 receives the game progress information. Instep S42, the processor 10 functions as the game coordinator 115 tocontrol the progress of the game in accordance with the game progressinformation.

In step S43, when the processor 10 receives the item-supply operationfrom the user 3 (YES in step S43), the processor 10 spends virtualcurrency and arranges the presentment object 674 in the virtual space600B in step S44. Here, the virtual currency may be purchased (chargedfor the main game) when the user 3 performs a predetermined operation onthe processor 10 before or during the participation in the game, or maybe given to the user 3 when predetermined conditions are satisfied. Thepredetermined conditions may be those that require participation in themain game such as clearing a quest in the main game, or those that donot require participation in the main game such as answering aquestionnaire. As an example, the amount of virtual currency (holdingamount of virtual currency) is stored in the user terminal 100 as gameinformation 132.

In step S45, the processor 10 sends the item-supply information to theserver 200. The item-supply information is sent to the game playterminal 300 via the server 200.

The processor 10 arranges item objects in the virtual space 600A when apredetermined time elapses after the arrangement of the presentmentobject 674. In the example of FIGS. 11A to 11D, the obstacle object 673is arranged. In other words, when the user 3 inputs a tap operation tothe UI image 711C, a predetermined amount of virtual currency is spentand the obstacle object 673 is arranged.

The processor 10 continues and repeats the processes of steps S41 to S45when the game is over. When the game is over, for example, when theplayer inputs a predetermined input operation for the end of the game orwhen the user 3 performs a predetermined input operation for leaving inthe middle of the game (YES in step S46), the processing shown in FIG.14 ends.

(Game Progress Processing in Server 200)

FIG. 15 is a flowchart showing an example of a flow of game progressprocessing to be executed by the server 200.

In step S51, the processor 20 receives the game progress informationfrom the game play terminal 300. In step S52, the processor 20 functionsas the log generator 212 to update a game progress log (hereinafter, aplay log). As an example, the play log is generated by the processor 20when the initial arrangement information is received from the game playterminal 300.

In step S53, the processor 20 sends the received game progressinformation to each of the user terminals 100.

In step S54, when the item-supply information is received from any userterminal 100 (YES in step S54), the processor 20 functions as the loggenerator 212 to update the play log in step S55. In step S56, theprocessor 20 sends the received item-supply information to the game playterminal 300.

The processor 20 continues and repeats the processes of steps S51 to S56until the game is over. When the game is over, for example, wheninformation indicating the game over is received from the game playterminal 300 (YES in step S57), the processor 20 functions as the listgenerator 213 to generate a list of users (user list 234), whoparticipate in the game, from the play log in step S58. The processor 20stores the generated user list 234 in the server 200.

FIG. 16 is a diagram showing a specific example of the user list 234. A“user” column stores information (for example, a user name) indicatingusers who participate in the game. A “tag” column stores information(tag) generated based on the support performed on the player by eachuser. In the example of FIG. 16, tags not having square brackets in tagsstored in the “tag” column are information automatically generated bythe processor 20, and tags having square brackets are informationmanually input by the operator of the game.

In the example of FIG. 16, the user “AAAAA” is associated with theinformation: A MAGAZINE, 10 F, A BOSS, and “WINNING AGAINST THE BOSSBECAUSE OF GIFT OF THE MAGAZINE”. This indicates that the user “AAAAA”supplies a magazine, for example, in a battle against a boss on a stageof a 10th floor and the avatar object 610 wins the boss with bullets ofthe supplied magazine.

In addition, the user “BBBBB” is associated with the information: AFIRST-AID KIT, 3 F, ZAKO, and “RESTORATION IMMEDIATELY BEFORE GAMEOVER”. This indicates that the user “BBBBB” supplies a first-aid kit,for example, in a battle against a Zako enemy (a low level enemy) on astage of a 3rd floor, and as a result, that the physical strength of theavatar object 610 is restored immediately before the physical strengthbecomes 0 (becomes game over).

In addition, the user “CCCCC” is associated with the information: ABARRICADE, 5 F, ZAKO, and “STOP TWO ZOMBIES FROM COMING HERE USINGBARRICADE”. This indicates that the user “CCCCC” supplies a barricade(obstacle object 672 in FIGS. 11A to 11D), for example, in a battleagainst a Zako enemy on a stage of a 5th floor, and as a result,succeeds in making two Zako enemies stuck.

In the example of FIG. 16, one support provided is associated with theuser name of each user 3, but a tag for each of the multiple times ofsupport can be associated with the user name of the user 3 who hasperformed the support several times. It is preferable that therespective tags are distinguished from one another in the user list 234.Thereby, after the game over, the player who refers to the user list 421using the transmission terminal 400 can accurately grasp the content ofeach support.

<Transmission of Behavior Instruction Data>

(Transmission Processing in Transmission Terminal 400)

FIG. 17 is a flowchart showing an example of a flow of transmissionprocessing by the transmission terminal 400. FIGS. 18A and 18B arediagrams showing a specific example of a screen displayed on thetransmission terminal 400. FIG. 19 is a diagram showing another specificexample of the screen displayed on the transmission terminal.

In step S61, the processor 40 functions as the operation receiver 413 toreceive a first operation for displaying the list (user list 234) ofusers who participate in the game. A download screen 721 shown in FIG.18A is a screen for downloading the user list 234 from the server 200and controlling the display unit 452 to display it. As an example, thedownload screen 721 is a screen to be displayed immediately after astart operation of an application for executing the transmissionprocessing shown in FIG. 17 is input to the transmission terminal 400.

The download screen 721 includes UI images 722 and 723 as an example.The UI image 722 receives an operation for downloading the user list234, that is, the first operation. The first operation may be, forexample, an operation for tapping the UI image 722. The UI image 723receives an operation for terminating the application. Such an operationmay be, for example, an operation for tapping the UI image 723.

Upon reception of the tap operation on the UI image 722, the processor40 functions as the communication controller 411 to acquire (receive)the user list 234 from the server 200 in step S62. In step S63, theprocessor 40 functions as the display controller 412 to control thedisplay unit 452 to display the user list 234. Specifically, theprocessor 40 controls the display unit 452 to display a user list screengenerated based on the user list 234. As an example, the user listscreen may be a user list screen 731 shown in FIG. 18B. The user listscreen 731 includes record images corresponding to respective records inthe user list 234. In the example of FIG. 18B, record images 732A to732C are described as the record images, but the number of record imagesis not limited to three. In the example of FIG. 18B, when the number ofrecords in the user list 234 is greater than 3 (that is, when the numberof users participating in the game is greater than 3), the player cancontrol the display unit 452 to display another record image by, forexample, inputting an operation of scrolling the screen (for example, adrag operation or a flick operation) to the touch screen 45.

As an example, the record images 732A to 732C include user names 733A to733C, tag information 734A to 734C, and icons 735A to 735C,respectively. Hereinafter, the record images 732A to 732C, the usernames 733A to 733C, the tag information 734A to 734C, and the icons 735Ato 735C are a “record image 732”, a “user name 733”, “tag information734”, and an “icon 735”, respectively, when being not necessary to bedistinguished from one another.

The user name 733 is information indicating each of users whoparticipate in the game stored in the “user” column in the user list234. The tag information 734 is information indicating a tag associatedwith each of users who participate in the game in the user list 234. Forexample, the record image 732A includes “AAAAA” as the user name 733A.Therefore, the record image 732A includes, as the tag information 734A,the information associated with the “AAAAA” in the user list 234: AMAGAZINE, 10 F, A BOSS, and “WINNING AGAINST THE BOSS BECAUSE OF GIFT OFTHE MAGAZINE”. The icon 735 is, for example, an image set in advance bythe user.

The processor 40 may store the received user list in the transmissionterminal 400 (in the user list 421 of FIG. 7). The download screen 721may include a UI image (not shown) for displaying the user list 421 onthe display unit 452. In this example, when the UI image is tapped, theprocessor 40 reads the user list 421 without downloading the user list234, generates a user list screen from the user list 421, and controlsthe display unit 452 to display the generated user list screen.

In step S64, the processor 40 functions as the operation receiver 413 toreceive a second operation for selecting any of the users included inthe user list screen 731. As an example, the second operation may be anoperation of tapping any of the record images 732 on the user listscreen 731. In the example of FIG. 18B, the player inputs a tapoperation to the record image 732A. In other words, the player selectsthe user “AAAAA” as a user who transmits the behavior instruction data.

Upon reception of the tap operation on the record image 732, theprocessor 40 functions as the display controller 412 to control thedisplay unit 452 to display the motion list 422. Specifically, theprocessor 40 controls the display unit 452 to display a motion listscreen generated based on the motion list 422. As an example, the motionlist screen may be a motion list screen 741 shown in FIG. 19. The motionlist screen 741 includes record images corresponding to respectiverecords in the motion list 422. In the example of FIG. 19, record images742A to 742C are described as the record images, but the number ofrecord images is not limited to three. In the example of FIG. 19, whenthe number of records in the motion list 422 is greater than 4, theplayer can control the display unit 452 to display another record imageby, for example, inputting an operation of scrolling the screen (forexample, a drag operation or a flick operation) to the touch screen 45.

As an example, the record images 742A to 742C include motion names 743Ato 743C, motion images 744A to 744C, and UI images 745A to 745C,respectively. Hereinafter, the record images 742A to 742C, the motionnames 743A to 743C, the motion images 744A to 744C, and the UI images745A to 745C are a “record image 7432”, a “motion name 743”, a “motionimage 744”, and a “UI image 745”, respectively, when being not necessaryto be distinguished from one another.

The motion name 743 is information for identifying the motion stored inthe motion list 422. The motion image 744 is an image generated frommotion data associated with each motion name in the motion list 422. Asan example, the processor 40 includes an image of the avatar object 610,which takes a first posture in each motion data, in the record image 742as the motion image 744. The motion image 744 may be a UI image thatreceives a predetermined operation (for example, a tap operation on themotion image 744) from the player. Upon reception of the predeterminedoperation, the processor 40 may reproduce a motion moving image in whichthe avatar object 610 behaves in accordance with the motion data. Theprocessor 40 may automatically display the motion list screen 741 againwhen the motion moving image is completed.

The record image 742 may include, for example, a UI image including thetext “motion reproduction” instead of the motion image 744.

In step S66, the processor 40 functions as the operation receiver 413 toreceive a third operation for selecting a motion. As an example, thethird operation may be a tap operation on the UI image 745. In otherwords, the UI image 745 receives an operation for selecting motion datacorresponding to each of the record images 742. By receiving the thirdoperation, the processor 40 functions as the motion specifier 415 tospecify the motion data selected by the player.

In step S67, the processor 40 functions as the display controller 412and the sound receiver 414 to receive a sound input of the player whilereproducing the motion moving image in which the avatar object 610behaves in accordance with the selected motion data.

FIG. 20 is a diagram showing a specific example of a sound input by aplayer 4. As shown in FIG. 20, the player 4 inputs speech sound 820Awhile reproducing a motion moving image 810A. The speech sound 820A is aspeech sound directed to the user 3 (hereinafter, user 3A) with a username “AAAAA”. In other words, in the example of FIG. 20, the player 4selects a user 3A (first user) in step S64, and creates behaviorinstruction data directed to the user 3A. It is assumed that the userterminal 100 used by the user 3A is a user terminal 100A.

Since the speech sound 820A is a speech sound directed to the user 3A,the speech sound is based on the content of the support provided for theavatar object 610 (in other words, the player 4) by the user 3A.Specifically, the user 3A supplies a magazine in a battle against a bosson a stage of a 10th floor, and the avatar object 610 wins the boss withbullets of the supplied magazine. Therefore, the speech sound 820Aincludes the contents “THANK YOU FOR GIVING ME THE MAGAZINE IN THEBATTLE AGAINST THE BOSS! THE TIMING WAS PERFECT! THANKS TO MR. AAAAA, IWAS ABLE TO CLEAR IT!”. As described above, it is preferable that thespeech sound includes the content of the support provided by the user 3in the game and gratitude to the user 3.

In an aspect, the player 4 creates a speech content directed to the user3 before starting the sound input, that is, before inputting the thirdoperation to the transmission terminal 400. In another aspect, thespeech content directed to the user 3 may be automatically generated bythe processor 40. In addition, the processor 40 may display the tagassociated with the user 3 selected by the second operation in a mannerof being superimposed on the motion moving image 810A.

The processor 40 converts the received sound into sound data. In stepS68, the processor 40 functions as the behavior instruction datagenerator 416 to generate behavior instruction data including the sounddata and the motion data of the selected motion.

In step S69, the processor 40 functions as the communication controller411 to transmit the generated behavior instruction data to the userterminal 100 (first computer) of the selected user 3 (user 3A in theexample of FIG. 20). FIGS. 21A to 21C are diagrams showing furtheranother specific example of the screen displayed on the transmissionterminal 400. After executing step S68, the processor 40 functions asthe display controller 412 to control the display unit 452 to displaythe transmission screen. As an example, the transmission screen may be atransmission screen 751 shown in FIG. 21A. The transmission screen 751includes a UI image 752 and a motion image 753A. Further, as shown inFIG. 21A, the transmission screen 751 may include information indicatinga user to whom the behavior instruction data is transmitted.

The UI image 752 receives an operation for transmitting the behaviorinstruction data to the selected user 3. The operation may be, forexample, a tap operation on the UI image 752. The motion image 753A is aUI image that receives an operation for reproducing the moving imagebased on the generated behavior instruction data, that is, the movingimage based on the behavior instruction data generated for the user 3A.The operation may be, for example, a tap operation on the motion image753A. The UI image, which receives the operation for reproducing thegenerated moving image, is not limited to the motion image 753A. Forexample, the UI image may be a UI image including a text “moving imagereproduction”. The processor 40 may automatically display thetransmission screen 751 again when the moving image is completed.

The transmission screen 751 may preferably further include a UI imagethat receives an operation for returning to the reception of the soundinput. The operation may be, for example, a tap operation on the UIimage. The transmission screen 751 includes the UI image, whereby theplayer 4 can perform the sound input again when the sound input fails,such as when the speech content is mistake. The UI image may be a UIimage that receives an operation for returning to the selection ofmotion data.

Upon reception of the tap operation on the UI image 752, the processor40 sends the behavior instruction data together with the informationindicating the user 3A to the server 200. The server 200 specifies theuser terminal 100, which is a destination of the behavior instructiondata, based on the information indicating the user 3A, and sends thebehavior instruction data to the specified user terminal 100 (that is,the user terminal 100A).

When the sending of the behavior instruction data is completed, theprocessor 40 may control the display unit 452 to display a transmissioncompletion screen 761 shown in FIG. 21B as an example. The transmissioncompletion screen 761 includes UI images 762 and 763 as an image.Further, the transmission completion screen 761 may include a textindicating that the sending of the behavior instruction data iscompleted, as shown in FIG. 21B.

The UI image 762 receives an operation for starting creation of behaviorinstruction data directed to another user 3. The operation may be, forexample, an operation of tapping the UI image 762. Upon reception of thetap operation, the processor 40 controls the display unit 452 to displaythe user list screen again. In other words, when the tap operation isreceived, the transmission process returns to step S63. At this time,the processor 40 may generate a user list screen based on the user list421 stored in the transmission terminal 400, and control the displayunit 452 to display the generated user list screen. The UI image 763receives an operation for completing the application. The operation maybe, for example, an operation of tapping the UI image 763. When theoperation is received, the transmission process ends.

In the example described with reference to FIGS. 20 and 21A to 21C, asshown in FIG. 21C, the transmission terminal 400 sends the behaviorinstruction data of the moving image directed to the user 3A (the user 3with the user name “AAAAA”) only to the user terminal 100A.

FIG. 22 is a diagram showing another specific example of a sound inputby the player 4. As shown in FIG. 22, the player 4 inputs a speech sound820B while reproducing a motion moving image 810B. The speech sound 820Bis a speech sound directed to the user 3 (hereinafter, user 3B) with auser name “BBBBB”. In other words, in the example of FIG. 22, the player4 inputs a tap operation on a record image 732B corresponding to theuser 3B and creates behavior instruction data directed to the user 3B instep S64. It is assumed that the user terminal 100 used by the user 3Bis a user terminal 100B.

Since the speech sound 820B is the speech sound directed to the user 3B,the speech sound is based on the content of the support provided for theavatar object 610 (in other words, the player 4) by the user 3B.Specifically, the user 3B of the user “BBBBB” supplies a first-aid kitin a battle against a Zako enemy on a stage of a 3rd floor, and as aresult, the physical strength of the avatar object 610 is restoredimmediately before the physical strength becomes 0 (becomes game over).For this reason, the speech sound 820B includes the contents “THANKS TOTHE FIRST-AID KIT THAT MR. BBBBB GAVE ME, I HAVE SURVIVED WITHOUT GAMEOVER ON THE 3RD FLOOR. THANKS SO MUCH!”.

FIGS. 23A to 23C are diagrams showing further another specific exampleof the screen displayed on the transmission terminal 400. Thetransmission screen 751 shown in FIG. 23A includes a UI image 752 and amotion image 753B. The motion image 753B reproduces a moving image inaccordance with the behavior instruction data generated for the user 3Bwhen receiving a tap operation.

Upon reception of the tap operation on the UI image 752, the processor40 sends the behavior instruction data together with the informationindicating the user 3B, to the server 200. The server 200 specifies theuser terminal 100, which is a destination of the behavior instructiondata, based on the information indicating the user 3B, and sends thebehavior instruction data to the specified user terminal 100 (that is,the user terminal 100B).

In the example described with reference to FIGS. 22 and 23A to 23C, asshown in FIG. 23C, the transmission terminal 400 sends the behaviorinstruction data of the moving image directed to the user 3B (the user 3with the user name “BBBBB”) only to the user terminal 100B.

As described above, the content of the sound based on the sound dataincluded in the behavior instruction data is based on the content of thesupport provided for the player 4 in participating in the latest game bythe user 3. Since the content of the support is different for each user3, the content of the sound is different for each user 3. In otherwords, after the game is over, behavior instruction data includingsounds having different contents is sent to at least some of the userterminals 100 of the users 3 who participates in the game.

Further, the motion of the avatar object 610 in the example of FIG. 22is different from the motion in the example of FIG. 20. In other words,the player 4 selects, in the generation of the behavior instruction datadirected to the user 3B, motion data different from that at the time ofthe generation of the behavior instruction data directed to the user 3A.Specifically, in step S66, the player 4 inputs a tap operation on the UIimage 745B that selects the motion data corresponding to the recordimage 742B. In this way, the player 4 can make the motion data includedin the behavior instruction data different for each user 3.

Then, the behavior instruction data for each user 3 including the sounddata having different contents for each user 3 and the motion dataselected for each user 3 is sent only to the user terminal 100 of eachuser 3. In other words, the unique behavior instruction data unique toeach of the user terminals 100 is sent to each of the user terminals 100of the selected user 3.

FIG. 24 is a diagram showing an overview of sending of game progressinformation from the game play terminal 300 to the user terminal 100.While the behavior instruction data for reproducing the moving image inthe user terminal 100 is unique for each of the user terminals 100, asshown in FIG. 24, the game progress information sent to the userterminals 100 of all of the users 3 participating in the game during thegame execution are common among the respective user terminals 100. Inother words, the behavior instruction data included in the game progressinformation is also common among the respective user terminals 100. Asdescribed above, it can be said that the behavior instruction data forreproducing the moving image is different from the behavior instructiondata for progressing the game from viewpoints of the difference betweenthe user terminals 100 and the destination.

(Moving Image Reproduction Processing in User Terminal 100)

FIG. 25 is a flowchart showing an example of moving image reproductionprocessing to be executed by the user terminal 100.

In step S71, the processor 10 functions as the moving image reproducer117 to receive the behavior instruction data. In step S72, the processor10 functions as the moving image reproducer 117 to notify the user 3 ofthe reception of the behavior instruction data. As an example, theprocessor 10 notifies the user 3 of the reception of the behaviorinstruction data, using at least one of a display of a notificationimage on the display unit 152, reproduction of a notification sound froma speaker (not shown), and lighting or flickering of a lighting unit(not shown) configured by an LED (light-emitting diode).

In step S73, the processor 10 functions as the operation receiver 111 toreceive a first reproduction operation for reproducing the moving image.As an example, the first reproduction operation may be an operation oftapping the notification image. In step S74, the processor 10 functionsas the moving image reproducer 117 to reproduce the moving image byrendering the behavior instruction data. As an example, the processor 10may start an application for playing the main game to reproduce themoving image, or may start an application for reproducing the movingimage different from the above-described application to reproduce themoving image. Hereinafter, the moving image will be referred to as a“thank-you moving image”.

FIG. 26 is a diagram showing a specific example of reproduction of athank-you moving image, and specifically, is a diagram showing anexample of reproduction of a thank-you moving image in the user terminal100 of the user 3A. In a thank-you moving image 910A reproduced in theuser terminal 100, the avatar object 610 throws out a sound 920A whileexecuting a certain motion. In other words, the processor 10 controlsthe speaker (not shown) to output the sound 920A while reproducing thethank-you moving image 910A including the avatar object 610 thatexecutes a certain motion.

The motion in the thank-you moving image 910A is based on the motiondata selected by the player 4 in the generation of the behaviorinstruction data directed to the user 3A, and the sound 920A is based onthe sound data generated from the speech sound 820A input by the player4 in the generation of the behavior instruction data. In other words,the sound 920A is a sound including the content of the support providedby the user 3A in the game and gratitude for the support. In this way,the user 3A can watch the thank-you moving image in which the avatarobject 610 speaks the content of the support provided by himself/herselfin the game and the gratitude for the support by the input of the firstreproduction operation.

As an example, the user terminal 100 may control the touch screen 15 todisplay at least one UI image after the reproduction of the thank-youmoving image 910A is completed. The UI image may be, for example, a UIimage that receives an operation for reproducing the thank-you movingimage 910A again, may be a UI image that receives an operation fortransitioning to another screen, or may be a UI image that receives anoperation for completing the application.

Further, as an example, the user terminal 100 may control the touchscreen 15 to display at least one UI image during the reproduction ofthe thank-you moving image 910A. The UI image may be, for example, aplurality of UI images that receive operations of temporarily stoppingor completing the thank-you moving image 910A being reproduced, orchanging a reproducing scene.

These UI images displayed during the reproduction of the thank-youmoving image 910A and after the thank-you moving image 910A is hunted donot include a UI image for answering to the avatar object 610. In otherwords, the thank-you moving image 910A according to the presentembodiment does not include a means for answering to the avatar object610.

FIG. 27 is a diagram showing another specific example of reproduction ofa thank-you moving image, and specifically, is a diagram showing anexample of reproduction of a thank-you moving image in the user terminal100 of the user 3B. In a thank-you moving image 910B reproduced in theuser terminal 100, the avatar object 610 throws out a sound 920B whileexecuting a certain motion. In other words, the processor 10 controlsthe speaker (not shown) to output the sound 920B while reproducing thethank-you moving image 910B including the avatar object 610 thatexecutes a certain motion.

The motion in the thank-you moving image 910B is based on the motiondata selected by the player 4 in the generation of the behaviorinstruction data directed to the user 3B, and the sound 920B is based onthe sound data generated from the speech sound 820B input by the player4 in the generation of the behavior instruction data. Therefore, themotion performed by the avatar object 610 in the example of FIG. 27 isdifferent from the motion in the example of FIG. 26. Further, the sound920B is a sound including the content of the support provided by theuser 3B in the game and gratitude for the support. Therefore, thecontent of the sound 920B in the example of FIG. 27 is different fromthe content of sound 920A in the example of FIG. 26.

As described above, the thank-you moving image received by at least someof the user terminals 100 of the users 3 participating in the game afterthe game is over is a moving image in which the speech content of theavatar object 610 is different for each user 3.

The processor 10 may display a UI image 930 including the content forurging participation in the next game in a manner of being superimposedon the moving image 910. The UI image 930 may be transmitted togetherwith the behavior instruction data, or may be stored in the userterminal 100 as the game information 132.

In this game, the game play terminal 300 transmits game progressinformation, which is a transmission content, to the plurality of userterminals 100 via the server 200. Each of the plurality of userterminals 100 displays the transmission content on the touch screen 15on the basis of the game progress information. Specifically, the memory11 of the user terminal 100 stores in advance plurality of types ofobject data for displaying objects including the avatar object 610. Whenthe user terminal 100 receives the game progress information from thegame play terminal 300, the user terminal 100 specifies behaviorinstruction data from the game progress information, and specifies thetype, position, and posture of each object by analyzing (rendering) thebehavior instruction data. Further, the user terminal 100 arranges theobjects including the avatar object 610 in the virtual space 600B usingthe object data stored in the memory 11, on the basis of the analysisresult. On the touch screen 15, the field-of-view image 660 of thefield-of-view area 640B in accordance with the position and direction ofthe current virtual camera 620B is displayed. The objects including theavatar object 610 are also arranged in the virtual space 600A defined bythe game play terminal 300, and the positions and postures of theobjects in the virtual space 600A coincide with the positions andpostures of the objects in the virtual space 600B.

The transmission content is provided with a plurality of types ofcontent having different characters displayed as the avatar object 610.The plurality of types of content include, for example, firsttransmission content that is transmitted once or irregularly and secondtransmission content that is periodically transmitted every day or at apredetermined time on a predetermined day of the week.

Each of the first transmission content and the second transmissioncontent is provided with, for example, a character appearing as aleading role or a facilitator, a character appearing in the content,progress, and others, and a plurality of types of content havingdifferent types of games played in the content. In the secondtransmission content, the same character in accordance with the type(for example, a character “a” in accordance with content “a”) appearsand the character background (for example, a wreath object) is displayedevery time, but the content of the same type (for example, the content“a”) has a different content every time.

A decoration object (a texture image) such as clothes or accessories isassociated with the character displayed as the avatar object 610 foreach type of character. A specific method of specifying a display modeof the decoration object will be described below.

The transmission content includes first character content in which afirst character appears in the virtual space 600B as the avatar object610 and second character content in which a second character appears inthe virtual space 600B as the avatar object 610. When the firstcharacter content is transmitted, the behavior instruction data is data(first display data) for making it possible to display the video of thevirtual space 600B in which the object including the first character isarranged. On the other hand, when the second character content istransmitted, the behavior instruction data is data (second display data)for making it possible to display the video of the virtual space 600B inwhich the object including the second character is arranged.

In both of the first character and the second character, the decorationobject corresponding to clothes and accessories (for example, necklace,earrings, and glasses) is associated with each part of upper body, lowerbody, hands, feet, neck, earlobe, and eyes in advance. The types andparts of the decoration object to be associated are defined to bedifferent depending on the type of the character.

In the present embodiment, the first character associates with adecoration object including a first object corresponding to a shirt anda third object (blouse) that is worn on the first object (shirt) tocover a part of the first object. On the other hand, the secondcharacter associates with a decoration object a second object (a shirthaving a different design, for example) of the same type as the firstobject.

Here, the display mode of the first object associated with the firstcharacter is determined in accordance with a predetermined rule (forexample, random number lottery) on the game play terminal 300 for eachtransmission, for example, at the time of start of transmission. Thegame play terminal 300 transmits the game progress information includingdisplay mode information, which can specify the display mode, to theuser terminal 100, and the user terminal 100 specifies and sets thedisplay mode of the first object based on the display mode information.On the other hand, the display mode of the decoration object other thanthe first object associated with the first character includes a displaymode of the third object and is fixed in advance. The user terminal 100sets the display mode of the decoration object other than the firstobject to a fixed display mode. On the other hand, the display mode ofthe decoration object associated with the second character includes thedisplay mode of the second object of the same type as the first object,and is fixed in advance. The user terminal 100 sets the display mode ofthe decoration object to a fixed display mode.

For this reason, the display mode of the first object associated withthe first character among the decoration objects is changed for eachtransmission. Here, the change of the display mode includes a change ofa texture image, and a texture image of the first object is changed foreach transmission. On the other hand, regarding the decoration objectother than the first object associated with the first character and thedecoration object associated with the second character, the display modeis fixed irrespective of the number of transmissions (transmissionperiod).

The display mode is a mode when the decoration object is displayed onthe display unit 152. In the present embodiment, an example isexemplified in which the display mode determined for the first object(shirt) is a display color of the first object (that is, a color of theshirt). Therefore, among the decoration objects such as shirts andblouses associated with the first character, the color of the shirt isspecified from a plurality of colors (white, black, red, green, blue,and purple).

In the present embodiment, the second transmission content to beperiodically transmitted includes, for example, the first charactercontent in which the first character appears whose display mode of thefirst object is changed every time. In the present embodiment, as thefirst character, for example, a character exhibiting the appearance ofan office lady is exemplified. However, the first character is notlimited thereto, and may be, for example, a character (for example, ahigh-school student character) whose age set as a character is less thana predetermined age (18 years old), a character exhibiting theappearance of a cheering party, and a character exhibiting theappearance of a female university student.

The content is transmitted from the game play terminal 300 during aprescribed transmission period. When the transmission of the content isstarted, the processor 30 of the game play terminal 300 executes adisplay mode control process shown in FIG. 28A. Further, viewing of thecontent on the user terminal 100 is started by a touch operation on aprescribed content icon from the user. When the viewing of the contentis started by the touch operation, the processor 10 on the user terminal100 executes a display mode setting process shown in FIG. 28B.

With reference to FIG. 28A, in step S81, the game play terminal 300determines based on a transmission schedule stored in memory 31 whethera current timing coincides with a start timing of content transmissionprescribed for each content. In other words, the memory 31 storesinformation on a time zone for transmitting the content and the type ofthe content (character appearing, that is, either of the first charactercontent or the second character content), as the transmission schedule.In step S81, it is determined based on the transmission schedule whetheror not the coincidence.

When it is determined that the current timing coincides with the starttiming, the process proceeds to step S82. In step S82, it is determinedbased on the transmission schedule whether the content to be transmittedcurrently is the first character content. When it is determined to bethe first character content, the process proceeds to step S83.

In step S83, the display mode (that is, the color of the shirt) of thefirst object among the decoration objects associated with the firstcharacter in the current transmission period is determined by a randomnumber lottery (in a random manner) from the plurality of types ofdisplay modes (white, black, red, green, blue, and purple, for example).More specifically, as described above, the first character content isthe second transmission content that is periodically transmitted, and instep S83, a display mode different from the display mode at the time ofprevious transmission determined at the time of previous transmission ofthe first character content is determined by a random number lottery.Thereby, the display mode (that is, the color of the shirt) of the firstobject is changed to a display mode different from that at the time ofthe previous transmission.

In step S84, display mode information (first data) capable of specifyingthe display mode determined in step S83 is set as the informationincluded in the game progress information. When the first charactercontent is transmitted, the game progress information including thedisplay mode information in accordance with the determination in stepS83, which is information in accordance with the motion of theperformer, is transmitted at predetermined time intervals (for example,1/60 second).

When the process of step S84 is completed, the process returns when itis not determined in step S81 that the current timing coincides with thestart timing of content transmission or when it is not determined instep S82 that the content to be transmitted currently is the firstcharacter content. When the content other than the first charactercontent is transmitted, the game progress information in accordance withthe motion of the performer is transmitted at predetermined timeintervals (for example, 1/60 second).

With reference to FIG. 28B, in step S91, the user terminal 100determines based on the input operation on the touch screen 15 whether aviewing start operation of content is performed. When it is notdetermined that the viewing start operation is performed, the processreturns, and when it is determined that the viewing start operation isperformed, the process proceeds to step S92. In step S92, it isdetermined by analysis of the game progress information whether the gameprogress information received from the game play terminal 300 includesthe display mode information.

When it is determined to include the display mode information, theprocess proceeds to step S93, and the display mode of the first objectin the current transmission period is set based on the display modeinformation. In other words, the display mode (that is, the color of theshirt) of the first object among the display modes of the decorationobjects in the current transmission period is set to the display mode(any one of white, black, red, green, blue, and purple), which isspecified by the display mode information. When the process of step S93is completed or when it is not determined in step S92 that the gameprogress information including the display mode information is received,the process proceeds to step S94.

In step S94, a fixed display mode is set as a display mode of objectsother than the first object among the decoration objects associated withthe first character. Further, during viewing of the content in which thecharacter other than the first character appears, in step S94, a fixeddisplay mode is set as a display mode of the decoration object(including a shirt) associated with the character (for example, thesecond character) different from the first character. In other words,when the first character content is transmitted, decoration objects (forexample, blouses, trousers, and shoes) other than the first object(shirt) among the decoration objects associated with the first characterare set to a fixed display mode (a fixed color). On the other hand, whenthe content (for example, the second character content) different fromthe first character content is transmitted, all of costume objectsassociated with the character (for example, the second character)different from the first character are set to a fixed display mode.

By the processes of steps S93 and S94, model data of the avatar object610 behaving in the virtual space 600B is generated. During the viewingof the content, the avatar object 610 based on the model data behaves onthe basis of the behavior instruction data included in the game progressinformation transmitted from the game play terminal 300. When theprocess of step S94 is completed, the process returns.

FIG. 29 shows a display example of an object including the firstcharacter during the viewing of the first character content. In FIG. 29,a wreath object reminiscent of a wreath is arranged behind the firstcharacter. The first character behaves on the basis of the behaviorinstruction data.

Decoration objects associated with the first character include a shirtto be worn on the upper body, a blouse worn on the shirt, trousers to beworn on the lower body, and shoes to be worn on the feet. Further, forthe decoration objects other than the shirt which is the first object,the color as the display mode is uniformly defined. For example, theblouse and the shoes are defined by white, and the trousers are definedby gray.

On the other hand, the shirt being the first object is set for eachcontent transmission with a different color from that at the time of theprevious transmission as shown in step S83 of FIG. 28. As the displaymode of the shirt, a white color is set as shown in FIG. 29A in Nth livetransmission for the first character content. Further, a gray color isset as shown in FIG. 29B in (N+1)th live transmission for the firstcharacter content, and a blue color (indicating that a striped patternin the drawing is blue) is set as shown in FIG. 29C in (N+2)th livetransmission for the first character content. As described above, withrespect to the first character content, the same first character appearswearing a shirt of a different color for each content transmission.

Effects of Present Embodiment

According to the present embodiment, the video of the virtual space 600Bincluding the first character, which moves in cooperation with thebehavior of the performer, is displayed on the basis of the behaviorinstruction data (first display data) transmitted from the game playterminal 300. Here, the prescribed first object (shirt) is associatedwith the first character, and the display mode (the color of the shirt)of the first object is changed in accordance with the predeterminedrule. Thereby, the display mode of the first object can be spontaneouslychanged, and as a result, the user can be given a sense of reality ofthe first character.

Further, according to the present embodiment, the video of the virtualspace 600B including the second character, which moves in cooperationwith the behavior of the performer, is displayed on the basis of thebehavior instruction data (second display data) transmitted from thegame play terminal 300. Here, the second object (shirt) of the same typeas the first object is associated with the second character, and thedisplay mode (the color of the shirt) of the second object is fixed.Thereby, a sense of reality of the first character can be remarkable.

Further, according to the present embodiment, the display mode of thefirst object is changed for each transmission period to the display modedifferent from the display mode in the previous transmission period.Thereby, it is possible to give the user the impression that the displaymode of the first object is intentionally changed for each transmission,and to give the user an interesting such as what kind of display modewill appear during this transmission period, whereby viewing rating ofthe transmission can be improved.

Further, according to the present embodiment, the first display data isdata transmitted from the game play terminal 300, and includes motiondata corresponding to the motion input by the performer. The video inwhich the first character behaves in the virtual space 600B is displayedby producing the behavior of the first character in the virtual space600B in real time based on the motion data. Thereby, it is possible toreduce the amount of data to be transmitted.

Further, according to the present embodiment, the display mode of thefirst object changed in accordance with the predetermined rule isspecified by the display mode information (first data) transmitted fromthe game play terminal 300. The display mode of the first object is setbased on the first data. Thereby, the display mode of the first objectin the plurality of user terminals 100 can be uniformly controlled onthe game play terminal 300.

Further, according to the present embodiment, the first character isassociated with the prescribed third object (blouse). The third objectis an object that covers at least a part of the first object. Thereby,it is possible to control how the first object is displayed by the thirdobject.

Modifications

Modifications of the embodiment described above will be listed below.

(1) In the above-described embodiment, the normal viewing mode has beendescribed in which the avatar object 610 behaves in the virtual space600B similar to the virtual space 600A, and the field-of-view image 660of the field-of-view area 640B depending on the position, direction, andinclination of the virtual camera 620B arranged in the virtual space600B is displayed on the touch screen 15 of the user terminal 100, thevirtual camera 620B being configured to be changed in accordance withthe swipe operation on the touch screen 15 of the user terminal 100.

However, the space where the avatar object 610 behaves is not limited tothe virtual space, and may be a real space. An example of the real spacemay include a space specified by the acquired image captured andacquired by the camera (imaging unit) 17. Specifically, for example,when the model is switched to the AR viewing mode, in the user terminal100, a plane surface portion such as a floor surface is specified byanalyzing the acquired image captured and acquired by the camera 17, andthe AR virtual space arranged with at least the avatar object 610 isarranged at a predetermined position (for example, a center position ofthe plane surface portion) of the plane surface portion. In this case,the virtual camera 620B is arranged at a position where the AR virtualspace is viewed in the same direction as the capturing direction of thecamera 17 at the time of capturing the acquired image. As a result, thedisplay unit 152 displays the image formed in the augmented realityspace such that the field-of-view image acquired from the virtual camera620B is superimposed on the image acquired by the camera 17. Further,the user terminal 100 detects the actual position, direction, andinclination of the camera 17, and changes the position, direction, andinclination of the virtual camera 620B depending on the position,direction, and inclination of the camera 17. Thereby, the acquired imagecan be changed in accordance with the change in the position, direction,and inclination of the camera 17.

In the user terminal 100 in which the AR mode is selected, the avatarobject 610 behaves in the augmented reality space where the objectsincluding the avatar object 610 are arranged on the acquired imageacquired by the camera 17. Thereby, the user can be given the impression(realism) as if the avatar object 610 is actually behaving in the realspace in front of the user.

FIGS. 30A and 30B show an example in which a character imitating afemale wearing a hat (hereinafter, referred to as a third character)appears in the virtual space 600B. The third character is associatedwith decoration objects, for example, a one-piece dress worn on theentire body of the third character, a hat worn on a head, and earringson ears. In FIGS. 30A and 30B, the earrings among the decoration objectsassociated with the third character corresponds to a first object. Forthis reason, the display mode of the earrings is set to a differentdisplay mode for each transmission in accordance with step S83 of FIG.28. The second transmission content transmitted periodically includes,for example, character content in which the third character whosedisplay mode of the first object is changed every time appears.

First, a normal viewing mode will be described with reference to FIG.30A. FIG. 30(A-1) shows a display example when the third character facesthe front and the forefinger of her right hand is raised in front. FIG.30(A-2) shows a display example when the third character facesdiagonally forward to the right and points forward with the forefingerof her right hand. In the normal viewing mode, the position, direction,and inclination of the virtual camera 620B are changed in accordancewith the swipe operation. However, the earrings are covered with the hatcorresponding to a third object, and no matter how the swipe operationis performed, the virtual camera 320B cannot be moved to a positionwhere the earrings can be seen (for example, a position where FIGS.30(B-3) and 30(B-4) to be described below can be displayed.) In thenormal viewing mode, as shown in FIG. 30A, an AR mode transition icon182 for switching to an AR viewing mode is normally displayed. The modecan be switched to the AR viewing mode by detection of a touch operationon the AR mode transition icon 182 in the normal viewing mode.

The AR viewing mode will be described with reference to FIG. 30B. FIGS.30(B-1) and 30(B-2) show display examples in the AR viewing mode at thesame timing as FIGS. 30(A-1) and 30(A-2), respectively. In the ARviewing mode, among the images of the augmented reality space in whichthe third character is arranged with respect to the acquired imagecaptured and acquired by the camera 17, the image from the virtualcamera 620B is displayed on the display unit 152. The third characterbehaves on the basis of the behavior instruction data transmitted fromthe game play terminal 300. Further, the position, direction, andinclination of the virtual camera 620B are changed in accordance withthe actual position, direction, and inclination of the camera 17. In theAR viewing mode, the AR mode transition icon 182 is displayed in ahighlighted manner (black-and-white inverse display in FIG. 30B) tonotify that the mode is being the AR viewing mode.

For this reason, when the position, direction, and the like of thecamera 17 are adjusted so as to look up the left ear from diagonallybelow the left side of the third character, the virtual camera 320Bmoves to the position where earring can be seen, and an image of theearring is displayed on the display unit 152 (see FIG. 30(B-3)). Inother words, the display mode of the earring can be confirmed byselecting the AR viewing mode and adjusting of the position, direction,and the like of the camera 17. As a result, the user can be motivated towatch in the AR viewing mode, and thus a taste can be improved. When theposition, direction, and the like of the camera 17 is adjusted so as tolook up the left half body of the third character from the feet of thethird character, an image of the left half body including legs as shownin FIG. 30(B-4) is displayed on the display unit 152.

As described above, in the AR viewing mode, the position, direction, andthe like of the camera 17 are adjusted, and thus the virtual camera 620Bcan be moved to the position where the earring as the first objectassociated with the third character can be displayed (for example, theposition looking up from the neck of the third character or the positionlooking up from the feet of the third character). As a result, theearring as the first object can be displayed, and the user can confirmthe display mode of the earring. On the other hand, in the normalviewing mode, as described above, no matter how the operation isperformed, the virtual camera 620B cannot be moved to the position wherethe earring as the first object associated with the third character canbe displayed (for example, the position looking up from the neck of thethird character or the position looking up from the feet of the thirdcharacter). As a result, the earring as the first object cannot bedisplayed, and the user cannot confirm the display mode of the earring.

In the AR viewing mode, the mode can be switched to the normal viewingmode by detection of the touch operation on the highlighted AR modetransition icon 182. In the AR viewing mode, the AR mode transition icon182 is highlighted and the AR mode resetting icon is normally displayed,whereby the AR mode may be reset (restarted) in response to the touch onthe AR mode resetting icon. When the AR mode is reset, the plane surfaceportion such as the floor surface is specified again, and thefield-of-view image in the AR virtual space 600C is arranged at apredetermined position of the plane surface portion.

When the highlighted AR mode transition icon 182 is tapped in a statewhere the first object is displayed in the AR viewing mode, theviewpoint of the virtual camera 620B is returned to the prescribedviewpoint (for example, the viewpoint that captures the virtual space600B from the front), or is changed to the viewpoint in which themovement amount of the virtual camera 620B is minimum within the movablerange of the virtual camera 620B in the normal mode. Thereby, thedeviation of the viewpoint before and after mode switching can bereduced as much as possible. Further, in the state where the firstobject is displayed in the AR viewing mode (for example, FIG. 30(B-3)),the AR mode transition icon 182 may not be temporarily displayed.

In the AR viewing mode, the virtual camera 620B is controlled insynchronization with the changes in the position, direction, andinclination of the camera 17. However, the virtual camera 620B maycontrol the position, direction, and inclination in accordance with theinput operation (for example, the swipe operation and the touchoperation) from the user. Thereby, the field-of-view area of the virtualcamera 620B can be changed depending on the operation input by the user,and as a result, the field-of-view image arranged on the acquired imagecan be changed. Specifically, the avatar objects (for example, only theavatar object 610, the avatar object 610 and other objects, and theentire virtual space) arranged on the acquired image may be rotated ormoved by the swipe operation. Thereby, for example, even when theaugmented reality space is generated and the avatar object 610 behavesin a narrow space where the position, direction and the like of the userterminal 100 cannot be sufficiently adjusted, the avatar object 610 canbe rotated and moved by the input operation on the touch screen 15.

Further, the TV mode may be provided as the viewing mode in which theposition, direction, and inclination of the virtual camera 620B arechanged on the basis of the operation of the switcher on the operatorside of the system 1, and the mode may be switched to the TV mode inaccordance with the user's operation. However, in the TV mode, thevirtual camera 320B cannot be moved to the position where the firstobject can be seen, that is, the first object cannot be displayed on thedisplay unit 152.

(2) In the above-described embodiment, the real-time rendering methodmay be used to reproduce the video in which the avatar object 610 isbehaving. However, the video may be reproduced by a moving imagetransmission method. In this case, regarding the first charactercontent, the first object whose display mode is changed in accordancewith the predetermined rule is associated with the first character inthe game play terminal 300, and the moving image data including thevideo in which the first character behaves in the virtual space istransmitted as the first display data from the game play terminal 300.On the touch screen 15 of the user terminal 100, the video is displayedin which the first character behaves in the virtual space on the basisof the moving image data.

(3) The display mode of the costume of the avatar object 610 in theabove-described embodiment is uniformly defined in accordance with thetype of the avatar object 610. However, the display mode of the costumeof the avatar object 610 can be different for each user depending on,for example, the degree of progress of the game (for example, wheneverthe user wins the game or whenever the user feeds items). For example,even when the game progress information sent from the game play terminal300 is the same, the costume of the avatar object 610 may be a costumein accordance with the degree of progress of the game. In this case, aplurality of types of costume data of the avatar object 610 may bestored in advance on each of the user terminals 100. The target forchanging the display mode of the avatar object 610 is not limited to thecostume, but may be a hairstyle, a skin color, and a degree of makeup.Thereby, the variation of the avatar object 610 can be increased withoutan increase of a processing load on the game play terminal 300 thatoutputs the game progress information, so that the user's attention canbe attracted.

Alternatively or additionally, the display mode of the avatar object 610may be different from the display mode displayed on the user terminal100 of another user in accordance with the charge by the user during thegame. In addition, the display mode of the avatar object 610 may bedifferent depending on the ranking of the user that is updated dependingon the result of the game. Further, the user terminal 100 capable of thefirst character content may be limited to some of the user terminals100, for example, the user terminal 100 of the user who has a largecharge during the game.

(4) In the above-described embodiment, the color of the display modes ofthe first object (shirt) is changed by the process of step S83. However,in step S83, the shape of the first object may be changed instead of orin combination with the color. For example, the shirt may be changedfrom a V-neck to a round neck, or the earring may be changed from a starto a ring. In step S83, instead of or in addition to the determinationof the color, shape, and type, the display (for example, to be worn) ornon-display (not to be worn) of the first object itself may bedetermined.

(5) In the above-described embodiment, any one of the decoration objectsassociated with the first character (for example, a shirt or an earring)is set as the first object, and the display mode of the first object ischanged. However, the first object is not limited to the shirt or theearring as long as it is an object associated with the first character,and may be an object such as socks, trousers, a hair clip, gloves, ahat, or underwear. Further, the object may be, for example, an objectrelated to the first character itself (for example, a hairstyle or anail) without being limited to the decoration object. Further, thedisplay mode of the first object associated with the first character maybe changed, and the display mode of the background object (for example,the wreath object) of the first character may be changed.

(6) In the above-described embodiment, among the decoration objectsassociated with the first character, the display mode of the decorationobjects other than the first object is fixed in advance. However, thedisplay mode of the decoration objects other than the first object maybe changed not for each transmission, but every transmission ofpredetermined number of times (five times), every season, and every timezone. Similarly, in the above-described embodiment, the display mode ofthe decoration object associated with the second character is fixed inadvance, but the display mode may also be changed every transmission ofpredetermined number of times (five times), every season, and every timezone.

(7) In the above-described embodiment, an example has been described inwhich the display mode of the first object associated with the character(the first character or the third character) appearing in the secondtransmission content that is transmitted periodically is changed foreach transmission. However, the display mode of the first objectassociated with the character appearing in the first transmissioncontent that is transmitted irregularly may also be changed to a displaymode different from that at the time of previous transmission.

<Supplementary Note>

Matters described in each of the above embodiments will be describedbelow as Supplementary notes.

(Supplementary Note 1):

According to an aspect of an embodiment shown in the present disclosure,there is provided a program to be executed in a terminal device (userterminal 100) which comprises a processor, the program causing theprocessor to execute: a step (S26) of receiving first display data(behavior instruction data) for enabling display of a video of a virtualspace including a first character (avatar object 610), which moves incooperation with a behavior of a performer; and a step (S29) ofdisplaying a video in which the first character behaves in the virtualspace, on the basis of the first display data, wherein the firstcharacter is associated with a prescribed first object, and a displaymode (color) of the first object is changed in accordance with apredetermined rule.

(Supplementary Note 2):

In Supplementary note 1, the program causes the processor to execute: astep (S26) of receiving second display data for enabling display of avideo of a virtual space including a second character (another avatarobject 610), which moves in cooperation with the behavior of theperformer; and a step (S29) of displaying a video in which the secondcharacter behaves in the virtual space, on the basis of the seconddisplay data, wherein the second character is associated with a secondobject (shirt) of the same type as the first object, and a display mode(color) of the second object is fixed.

(Supplementary Note 3):

In Supplementary note 1 or Supplementary note 2, the display mode of thefirst object is changed to a display mode different from a display modein a previous transmission period, every transmission period.

(Supplementary Note 4):

In any one of Supplementary notes 1 to 3, the first display data is datatransmitted from an external source and including motion datacorresponding to a motion input by the performer; and the step ofdisplaying the video includes producing a behavior of the firstcharacter in the virtual space in real time on the basis of the motiondata to display the video in which the first character behaves in thevirtual space.

(Supplementary Note 5):

In Supplementary note 4, the program causes the processor to execute: asteps (S92) of receiving first data (display mode information) forspecifying the display mode of the first object that is changed inaccordance with the predetermined rule; and a step (S93) of setting thedisplay mode of the first object on the basis of the first data.

(Supplementary Note 6):

In Supplementary note 4 or Supplementary note 5, the program causes theprocessor to execute the step of setting to any one of a plurality oftypes of viewing modes (normal viewing mode, AR viewing mode) in whichat least a part of a mode for specifying a viewpoint is different; thestep of displaying the video includes displaying the video of thevirtual space as viewed from the specified viewpoint; and a viewpoint ismovable to a position where the first object is displayed in a case of afirst viewing mode (AR viewing mode) among the plurality of types ofviewing modes, and a viewpoint is not movable to the position where thefirst object is displayed in a case of a mode other than the firstviewing mode.

(Supplementary Note 7):

In Supplementary note 6, the terminal device includes a detection unitthat detects a position and a direction of the terminal device and atouch screen; the first viewing mode is a viewing mode in which aviewpoint is specifiable on the basis of the position and the directiondetected by the detection unit; the plurality of types of viewing modesinclude a second viewing mode (normal viewing mode) in which a viewpointis specified on the basis of a touch operation on the touch screen; anda viewpoint is not movable to the position where the first object isdisplayed in a case of the second viewing mode among the plurality oftypes of viewing modes.

(Supplementary Note 8):

In any one of Supplementary notes 1 to 3, the first display data is datatransmitted from an external source, and moving image data including thevideo in which the first character associated with the first objectwhose display mode is changed in accordance with the predetermined rulebehaves in the virtual space; and the step of displaying the videoincludes displaying the video in which the first character behaves inthe virtual space on the basis of the moving image data.

(Supplementary Note 9):

In any one of Supplementary notes 1 to 8, the first character isassociated with a prescribed third object; and the third object is anobject that covers at least a part of the first object.

(Supplementary Note 10):

According to another aspect of an embodiment shown in the presentdisclosure, there is provided a method to be executed by a terminaldevice which includes a processor, the method including: a step ofreceiving first display data for enabling display of a video of avirtual space including a first character, which moves in cooperationwith a behavior of a performer; and a step of displaying a video inwhich the first character behaves in the virtual space, on the basis ofthe first display data, wherein the first character is associated with aprescribed first object, and a display mode of the first object ischanged in accordance with a predetermined rule.

(Supplementary Note 11):

According to further another aspect of an embodiment shown in thepresent disclosure, there is provided a terminal device which includes aprocessor, the terminal device being configured to: receive firstdisplay data for enabling display of a video of a virtual spaceincluding a first character, which moves in cooperation with a behaviorof a performer; and display a video in which the first character behavesin the virtual space, on the basis of the first display data, whereinthe first character is associated with a prescribed first object, and adisplay mode of the first object is changed in accordance with apredetermined rule.

[Implementation Example by Software]

The control blocks (particularly, the control units 110, 210, 310, and410) of the user terminal 100, the server 200, the game play terminal300 (HMD set 1000), and the transmission terminal 400 may be implementedby a logic circuit (hardware) formed in an integrated circuit (IC chip),or may be implemented by software.

In the latter case, each of the user terminal 100, the server 200, thegame play terminal 300 (HMD set 1000), and the transmission terminal 400includes a computer that performs instructions of a program beingsoftware for implementing each function. The computer includes, forexample, one or more processors and a computer-readable recording mediumstored with the above-described program. In the computer, the processorreads from the recording medium and performs the program to achieve theobject of the present invention. As the above-described processor, a CPU(Central Processing Unit) can be used, for example. As theabove-described recording medium, a “non-transitory tangible medium”such as a ROM (Read Only Memory) as well as a tape, a disk, a card, asemiconductor memory, and a programmable logic circuit can be used. ARAM (Random Access Memory) or the like in which the above-describedprogram is developed may be further included. The above-describedprogram may be supplied to the above-described computer via an arbitrarytransmission medium (such as a communication network and a broadcastwave) capable of sending the program. Note that an aspect of the presentinvention may also be implemented in a form of a data signal embedded ina carrier wave in which the program is embodied by electronictransmission.

An aspect of the present invention is not limited to each of theabove-described embodiments, various modifications are possible withinthe scope of the present invention defined by aspects, and embodimentsthat are made by suitably combining technical means disclosed accordingto the different embodiments are also included in the technical scope ofan aspect of the present invention.

REFERENCE SIGNS LIST

-   1: system;-   2: network;-   3, 3A, 3B: users (first users);-   4: player (performer);-   10, 20, 30, 40: processors;-   11, 21, 31, 41: memories;-   12, 22, 32, 42: storages;-   13, 23, 33, 43: communication IFs;-   14, 24, 34, 44: input/output IFs;-   15, 45: touch screens;-   17: camera;-   18: ranging sensor;-   51: monitor;-   52: gaze sensor;-   53: first camera;-   54: second camera;-   55: microphone;-   56: speaker;-   100, 100A, 100B, 100C: user terminals (computer, first computer,    first information processing unit);-   110, 210, 310, 410: control units (first control unit, second    control unit);-   111, 311, 413: operation receivers;-   112, 312, 412: display controllers;-   113, 313: UI controllers;-   114, 314: animation generators;-   115, 315: game coordinators;-   116, 316: virtual space controllers;-   117: moving image reproducer;-   120, 220, 320, 420: storage units (first storage unit, second    storage unit);-   131, 231, 331: game programs (program, first program);-   132, 232, 332: game information;-   133, 233, 333: user information;-   151, 451: input units;-   152, 452: display units (display);-   200: server;-   211: communication mediator;-   212: log generator;-   213: list generator;-   234, 421: user lists;-   300: game play terminal (external device, second external device);-   317: response processor;-   400: transmission terminal (external device, first external device,    computer, second information processing unit);-   411: communication controller;-   414: sound receiver;-   415: motion specifier;-   416: behavior instruction data generator;-   422: motion list;-   423: transmission program (program, second program);-   540, 1020, 1021: controllers;-   500: HMD;-   510: HMD sensor;-   520: motion sensor;-   530: display;-   600A, 600B: virtual spaces;-   610: avatar object (character);-   620A, 620B: virtual cameras;-   631, 632, 633, 634: objects;-   640A, 640B: field-of-view areas;-   650, 660: field-of-view images;-   671: enemy objects;-   672, 673: obstacle objects;-   674: presentment object;-   691, 692: speeches;-   701, 702, 703A, 70B, 704A, 704B, 705, 706, 711, 711A, 711B, 711C,    711D, 722, 723, 745,-   745A, 745B, 745C, 752, 762, 763, 930, 2011, 2022, 2031, 2032, 2033,    2034, 2037, 2038, 2051,-   2063, 2072, 2073, 2075: UI images (message UI, UI);-   721: download screen;-   731: user list screen (list);-   732, 732A, 732B, 732C, 742, 742A, 742B, 742C: record images;-   733, 733A, 733B, 733C: user names;-   734, 734A, 734B, 734C: tag information;-   735, 735A, 735B, 735C: icons;-   741: motion list screen (option);-   743, 743A, 743B, 743C: motion names;-   744, 744A, 744B, 744C, 753: motion images;-   751: transmission screen;-   761: transmission completion screen;-   810A, 810B: motion moving images;-   820A, 820B: speech sounds;-   910A, 910B: moving images;-   920A, 920B: sound;-   1000: HMD set;-   1010: object;-   1030: storage medium;-   2010: home screen;-   2020: ranking screen;-   2021: title image;-   2026, 2026A, 2026B: ranking;-   2027, 2027A, 2027B: amount of charge;-   2028, 2028A, 2028B: the number of sending processes;-   2029: notification of completion of sending;-   2030: last sending date;-   2035: detailed display area;-   2036: scroll bar;-   2040: detailed screen;-   2050, 2060: preparation screens;-   2052: text;-   2053, 2061: selected images;-   2054A, 2054B, 2054C, 2062A, 2062B, 2062C, 2062D, 2062E, 2062F:    options;-   2070: sound input screen; and-   2074: tag image.

1. A non-transitory, tangible computer readable storage medium having aprogram to be executed in a terminal device which comprises a processor,the program causing the processor to execute steps of: receiving firstdisplay data for enabling display of a video of a virtual spaceincluding a first character, which moves in cooperation with a behaviorof a performer; and displaying a video in which the first characterbehaves in the virtual space, on the basis of the first display data,wherein: the first character is associated with a prescribed firstobject; and a display mode of the first object is changed in accordancewith a predetermined rule.
 2. The non-transitory, tangible computerreadable storage medium according to claim 1, wherein the program causesthe processor to execute steps of: receiving second display data forenabling display of a video of a virtual space including a secondcharacter, which moves in cooperation with the behavior of theperformer; and displaying a video in which the second character behavesin the virtual space, on the basis of the second display data, wherein:the second character is associated with a second object of the same typeas the first object; and a display mode of the second object is fixed.3. The non-transitory, tangible computer readable storage mediumaccording to claim 1, wherein the display mode of the first object ischanged to a display mode different from a display mode in a previoustransmission period, every transmission period.
 4. The non-transitory,tangible computer readable storage medium according to claim 1, wherein:the first display data is data transmitted from an external source andincluding motion data corresponding to a motion input by the performer;and the step of displaying the video includes producing a behavior ofthe first character in the virtual space in real time on the basis ofthe motion data to display the video in which the first characterbehaves in the virtual space.
 5. The non-transitory, tangible computerreadable storage medium according to claim 4, wherein the program causesthe processor to execute steps of: receiving first data for specifyingthe display mode of the first object that is changed in accordance withthe predetermined rule; and setting the display mode of the first objecton the basis of the first data.
 6. The non-transitory, tangible computerreadable storage medium according to claim 4, wherein: the programcauses the processor to execute the step of setting to any one of aplurality of types of viewing modes in which at least a part of a modefor specifying a viewpoint is different; the step of displaying thevideo includes displaying the video of the virtual space as viewed fromthe specified viewpoint; and a viewpoint is movable to a position wherethe first object is displayed in a case of a first viewing mode amongthe plurality of types of viewing modes, and a viewpoint is not movableto the position where the first object is displayed in a case of a modeother than the first viewing mode.
 7. The non-transitory, tangiblecomputer readable storage medium according to claim 6, wherein: theterminal device includes a detection unit that detects a position and adirection of the terminal device and a touch screen; the first viewingmode is a viewing mode in which a viewpoint is specifiable on the basisof the position and the direction detected by the detection unit; theplurality of types of viewing modes include a second viewing mode inwhich a viewpoint is specified on the basis of a touch operation on thetouch screen; and a viewpoint is not movable to the position where thefirst object is displayed in a case of the second viewing mode among theplurality of types of viewing modes.
 8. The non-transitory, tangiblecomputer readable storage medium according to claim 1, wherein: thefirst display data is data transmitted from an external source, andmoving image data including the video in which the first characterassociated with the first object whose display mode is changed inaccordance with the predetermined rule behaves in the virtual space; andthe step of displaying the video includes displaying the video in whichthe first character behaves in the virtual space on the basis of themoving image data.
 9. The non-transitory, tangible computer readablestorage medium according to claim 1, wherein: the first character isassociated with a prescribed third object; and the third object is anobject that covers at least a part of the first object.
 10. A method tobe executed by a terminal device which comprises a processor, the methodcomprising steps of: receiving first display data for enabling displayof a video of a virtual space including a first character, which movesin cooperation with a behavior of a performer; and displaying a video inwhich the first character behaves in the virtual space, on the basis ofthe first display data, wherein: the first character is associated witha prescribed first object; and a display mode of the first object ischanged in accordance with a predetermined rule.
 11. A terminal devicewhich comprises a processor, the terminal device being configured to:receive first display data for enabling display of a video of a virtualspace including a first character, which moves in cooperation with abehavior of a performer; and display a video in which the firstcharacter behaves in the virtual space, on the basis of the firstdisplay data, wherein: the first character is associated with aprescribed first object; and a display mode of the first object ischanged in accordance with a predetermined rule.